00000001:02000400:1.0F:1788874828.964191:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788874851.080230:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788874853.557737:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 382 MB/s 00000001:01000000:2.0F:1788874853.808093:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 483 MB/s 00000001:01000000:0.0:1788874854.059884:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3400 MB/s 00000020:02000000:0.0:1788874854.915235:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gcfd7996 00000400:02000000:1.0:1788874856.141903:0:3287:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.107@tcp [8/256/0/180] 00008000:02000000:2.0:1788874860.623394:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1788874920.312119:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788874930.882047:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788874930.882053:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788874930.882196:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006987ba8b 00000080:02000400:1.0:1788874930.882207:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788874930.887540:0:5821:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788874930.887558:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788874930.887607:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000047f3f2db) 00000020:00000080:1.0:1788874930.887631:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788874930.905377:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788874930.906185:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788874930.942839:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788874930.942879:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788874930.942897:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788874930.942941:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788874930.942962:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788874930.943370:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788874930.943377:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788874930.943387:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d81ef2 00000020:01000004:3.0:1788874930.943394:0:5821:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788874930.943400:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788874930.943405:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006987ba8b from MGS 00000020:01000004:3.0:1788874930.943410:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788874930.943438:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c877d1b8) 00000020:00000080:3.0:1788874930.943450:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788874930.945640:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006987ba8b from MGS, refs=2 00080000:01000000:3.0:1788874930.945663:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788874930.945675:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d81f00 00000100:00100000:3.0:1788874930.945835:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788874930.945994:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788874930.946001:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788874930.947440:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788874930.947452:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788874930.948643:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788874930.948968:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788874930.948975:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788874930.949880:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788874930.949887:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788874930.950835:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788874930.950845:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788874930.951556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874930.951982:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874930.951986:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874930.951988:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874930.952596:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788874930.953852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874930.953856:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874930.973635:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788874931.201901:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3043 MB/s 00000001:01000000:3.0:1788874931.455331:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2893 MB/s 00000001:01000000:3.0:1788874931.707447:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 416 MB/s 00000001:01000000:0.0:1788874931.957518:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 631 MB/s 00080000:10000000:1.0:1788874931.977619:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788874931.990229:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788874932.009067:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788874932.009088:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788874932.009092:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788874932.015352:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788874932.015494:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788874932.015559:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788874932.016166:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788874932.016203:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788874932.016769:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874932.016980:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788874932.016986:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788874932.017874:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788874932.017884:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788874932.018556:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788874932.018564:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788874932.021461:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788874932.021491:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.107@tcp' 00000020:01000004:3.0:1788874932.021493:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788874932.021544:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.107@tcp (typ=mgc) 00000020:00000080:3.0:1788874932.021558:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.107@tcp (00000000929afd49) 00000020:00000080:3.0:1788874932.021587:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788874932.021677:0:5821:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005a4b0e7f@MGC192.168.202.107@tcp: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1788874932.022230:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.107@tcp-0 is initialized 00000040:01000000:3.0:1788874932.022244:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788874932.023923:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788874932.023966:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.107@tcp (uuid 372e367e-0deb-4060-9f2e-265b56425d5a) 00000020:00000080:0.0:1788874932.023986:0:5821:0:(genops.c:1385:class_connect()) connect: client 372e367e-0deb-4060-9f2e-265b56425d5a, cookie 0x60858e6020d81f0e 00000100:00080000:0.0:1788874932.023997:0:5821:0:(import.c:545:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788874932.024002:0:5821:0:(import.c:665:import_select_connection()) MGC192.168.202.107@tcp: import 000000005a4b0e7f using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788874932.024401:0:5821:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000683c61ad x1875771241005184/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788874932.024440:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 372e367e-0deb-4060-9f2e-265b56425d5a->MGS 00000020:01000004:0.0:1788874932.024460:0:5821:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788874932.024466:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00080000:1.0:1788874932.029858:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788874932.030112:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000683c61ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241005184:0@lo:250: 00000100:00100000:2.0:1788874932.030221:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874932.030296:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005184 00000100:00100000:2.0:1788874932.030304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005184 00000100:00100000:2.0:1788874932.030346:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874932.030353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a8a3294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875771241005184:12345-0@lo:250: 00010000:00080000:2.0:1788874932.030380:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 372e367e-0deb-4060-9f2e-265b56425d5a@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:2.0:1788874932.030419:0:5833:0:(genops.c:1385:class_connect()) connect: client 372e367e-0deb-4060-9f2e-265b56425d5a, cookie 0x60858e6020d81f15 00000100:00080000:2.0:1788874932.030578:0:5833:0:(import.c:65:import_set_state_nolock()) 0000000090740e51 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788874932.030632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a8a3294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+5:3302:x1875771241005184:12345-0@lo:250: Request processed in 277us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874932.030640:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874932.030861:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.107@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788874932.030872:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.107@tcp: connect to target with instance 0 00000100:00080000:2.0:1788874932.030880:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.107@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788874932.030884:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788874932.030887:0:3302:0:(import.c:65:import_set_state_nolock()) 000000005a4b0e7f MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788874932.030890:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788874932.030898:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788874932.030904:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000683c61ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241005184:0@lo:250: 00000020:00000080:0.0:1788874932.033163:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a4ab57f1) 00000020:00000080:0.0:1788874932.033187:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788874932.068455:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788874932.070495:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788874932.070507:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788874932.073654:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788874932.073737:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788874932.074557:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788874932.074565:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788874932.081902:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788874932.083159:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788874932.083170:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788874932.088250:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788874932.088264:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788874932.176759:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788874932.177227:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788874932.177235:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788874932.182301:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788874932.182315:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788874932.183132:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788874932.183302:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788874932.183307:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788874932.184302:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788874932.184311:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788874932.186280:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788874932.186493:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788874932.186500:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788874932.187755:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788874932.187765:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788874932.194265:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874932.194585:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788874932.194599:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788874932.196303:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788874932.196315:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788874932.273231:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874932.273448:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788874932.273454:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788874932.275305:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788874932.275318:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788874932.280956:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788874932.280979:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788874932.283276:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788874932.283299:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788874932.283306:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788874932.283434:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788874932.283467:0:5821:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788874932.283470:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788874932.283472:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874932.283473:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874932.283474:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788874932.283475:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874932.283476:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874932.283477:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874932.283479:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874932.283480:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788874932.283481:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788874932.283482:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874932.283483:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788874932.283485:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788874932.283487:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788874932.283488:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874932.283489:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874932.283490:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788874932.283491:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874932.283492:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874932.283493:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874932.283494:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874932.283494:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788874932.283495:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788874932.283496:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874932.283496:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788874932.283532:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788874932.283549:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005312:0@lo:253: 00000100:00100000:2.0:1788874932.283631:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874932.284095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005312 00000100:00100000:1.0:1788874932.284103:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005312 00000100:00100000:1.0:1788874932.284157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874932.284164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000688b6c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+5:5821:x1875771241005312:12345-0@lo:253: 20000000:01000000:1.0:1788874932.284208:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788874932.284211:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1788874932.284816:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000007870ee59 going to sleep for 11 seconds 10000000:01000000:1.0:1788874932.292196:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788874932.292266:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788874932.292573:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788874932.296565:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788874932.302750:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788874932.302758:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788874932.302765:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788874932.302768:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788874932.302805:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788874932.303060:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788874932.303321:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788874932.303335:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788874932.303396:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788874932.303463:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788874932.303515:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788874932.303605:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788874932.303614:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788874932.303674:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788874932.303684:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788874932.303717:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788874932.303725:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788874932.303756:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788874932.303845:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788874932.303880:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788874932.303885:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788874932.303900:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788874932.304094:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788874932.304104:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788874932.304139:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788874932.304175:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788874932.304221:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788874932.304233:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788874932.304305:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788874932.304315:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788874932.304354:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788874932.304390:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788874932.304438:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788874932.304450:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788874932.304544:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788874932.304554:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788874932.304584:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788874932.304618:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788874932.304815:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788874932.304867:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788874932.304887:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788874932.306199:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788874932.306624:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788874932.306724:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.107@tcp for mdt 20000000:01000000:1.0:1788874932.306726:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:1.0:1788874932.306767:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788874932.306997:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788874932.307039:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788874932.307047:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:1.0:1788874932.307096:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788874932.307107:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788874932.307138:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788874932.307171:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788874932.307239:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788874932.307243:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788874932.307249:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788874932.307255:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788874932.309290:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788874932.309450:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788874932.319474:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788874932.319527:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788874932.319599:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788874932.319619:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788874932.319622:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788874932.319625:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788874932.319638:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788874932.319640:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788874932.319684:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788874932.319687:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788874932.320392:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788874932.320672:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788874932.320715:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788874932.320804:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1788874932.320819:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788874932.320821:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788874932.321561:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788874932.321964:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788874932.322010:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788874932.322049:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788874932.322065:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788874932.322067:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788874932.322073:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788874932.322093:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322110:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322120:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322125:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322131:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322138:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322144:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2c0f40e already unused, calling callback (00000000ff54563b) 00010000:00010000:2.0:1788874932.322154:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322162:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322176:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322184:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.322190:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2c0f40e/0x60858e6020d81f23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788874932.322209:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788874932.619298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000688b6c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+5:5821:x1875771241005312:12345-0@lo:253: Request processed in 335126us (335658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874932.619328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788874932.619516:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005312:0@lo:253: 10000000:01000000:2.0:1788874932.619532:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788874932.619535:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788874932.619537:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874932.619538:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874932.619539:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788874932.619540:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874932.619541:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874932.619542:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874932.619544:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874932.619545:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788874932.619547:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874932.619548:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788874932.619570:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006987ba8b from lustre-MDT0000 10000000:01000000:2.0:1788874932.619594:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788874932.619598:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788874932.619602:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e5a0472b380 10000000:01000000:2.0:1788874932.619606:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788874932.619620:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e5a0472b380 from 1 10000000:01000000:2.0:1788874932.619623:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788874932.619655:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.619665:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.619673:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874932.619689:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005440:0@lo:101: 00000100:00100000:2.0:1788874932.619734:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874932.619819:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e56aed9 going to sleep for 11 seconds 00000100:00100000:0.0:1788874932.619886:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005440 00000100:00100000:0.0:1788874932.619892:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005440 00000100:00100000:0.0:1788874932.619934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874932.619942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eeb34387 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+5:5821:x1875771241005440:12345-0@lo:101: 00010000:00010000:0.0:1788874932.619955:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874932.619970:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065f163b3/0x60858e6020d81f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81f2a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874932.620158:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065f163b3/0x60858e6020d81f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81f2a expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874932.620169:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065f163b3/0x60858e6020d81f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f2a expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874932.620179:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065f163b3, rc 0) 00000100:00100000:0.0:1788874932.620262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eeb34387 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+6:5821:x1875771241005440:12345-0@lo:101: Request processed in 321us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874932.620268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874932.620804:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005440:0@lo:101: 00010000:00010000:2.0:1788874932.620820:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874932.620829:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874932.620882:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005568:0@lo:501: 00000100:00100000:2.0:1788874932.620914:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874932.621000:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e56aed9 going to sleep for 11 seconds 00000100:00100000:0.0:1788874932.621164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005568 00000100:00100000:0.0:1788874932.621170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005568 00000100:00100000:0.0:1788874932.621241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874932.621248:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094444231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+6:5821:x1875771241005568:12345-0@lo:501: 00000100:00100000:0.0:1788874932.621517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094444231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+6:5821:x1875771241005568:12345-0@lo:501: Request processed in 269us (602us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788874932.621525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788874932.621597:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d865247e pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005568:0@lo:501: 10000000:01000000:1.0:1788874932.621624:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788874932.621641:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.621649:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000b2c0f40e/0x60858e6020d81f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874932.621658:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5a06641800 10000000:01000000:1.0:1788874932.621663:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788874932.621666:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e5a06641800 10000000:01000000:1.0:1788874932.621669:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788874932.621671:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e5a06641800 from 1 10000000:01000000:1.0:1788874932.621673:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788874932.621706:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.621713:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.621721:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874932.621733:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005696:0@lo:101: 00000100:00100000:1.0:1788874932.621762:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874932.622751:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d3d71b5 going to sleep for 11 seconds 00000100:00100000:2.0:1788874932.622932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005696 00000100:00100000:2.0:1788874932.622940:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005696 00000100:00100000:3.0:1788874932.623157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788874932.623166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058358559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+6:5821:x1875771241005696:12345-0@lo:101: 00010000:00010000:3.0:1788874932.623181:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874932.623199:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b0ff43b/0x60858e6020d81f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81f38 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623220:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b0ff43b/0x60858e6020d81f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81f38 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623230:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b0ff43b/0x60858e6020d81f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f38 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623238:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b0ff43b, rc 0) 00000100:00100000:3.0:1788874932.623306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058358559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+7:5821:x1875771241005696:12345-0@lo:101: Request processed in 141us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874932.623446:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005696:0@lo:101: 00010000:00010000:1.0:1788874932.623462:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.623470:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874932.623487:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788874932.623503:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.623510:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 0000000015296a91/0x60858e6020d81f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874932.623517:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788874932.623521:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788874932.623525:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e5a06641800 10000000:01000000:1.0:1788874932.623527:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788874932.623530:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788874932.623532:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788874932.623551:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.623558:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.623565:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874932.623579:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005824:0@lo:101: 00000100:00100000:1.0:1788874932.623614:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874932.623635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788874932.623749:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d3d71b5 going to sleep for 11 seconds 00000100:00100000:3.0:1788874932.623862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005824 00000100:00100000:3.0:1788874932.623867:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005824 00000100:00100000:3.0:1788874932.623885:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788874932.623890:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fba596e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+7:5821:x1875771241005824:12345-0@lo:101: 00010000:00010000:3.0:1788874932.623897:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874932.623904:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094213797/0x60858e6020d81f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81f46 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623917:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094213797/0x60858e6020d81f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81f46 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623924:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094213797/0x60858e6020d81f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f46 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874932.623935:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094213797, rc 0) 00000100:00100000:3.0:1788874932.623961:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fba596e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+8:5821:x1875771241005824:12345-0@lo:101: Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874932.623966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788874932.624108:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005824:0@lo:101: 00010000:00010000:1.0:1788874932.624118:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874932.624124:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874932.624166:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005952:0@lo:501: 00000100:00100000:1.0:1788874932.624191:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874932.624215:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d3d71b5 going to sleep for 11 seconds 00000100:00100000:3.0:1788874932.624333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241005952 00000100:00100000:3.0:1788874932.624337:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241005952 00000100:00100000:3.0:1788874932.624366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788874932.624371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d725d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+8:5821:x1875771241005952:12345-0@lo:501: 00000100:00100000:3.0:1788874932.624606:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d725d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+9:5821:x1875771241005952:12345-0@lo:501: Request processed in 234us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874932.624614:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874932.624927:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241005952:0@lo:501: 00000100:00100000:1.0:1788874932.624957:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006080:0@lo:503: 00000100:00100000:1.0:1788874932.625000:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874932.625026:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d3d71b5 going to sleep for 11 seconds 00000100:00100000:3.0:1788874932.625079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006080 00000100:00100000:3.0:1788874932.625083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006080 00000100:00100000:3.0:1788874932.625183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788874932.625189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbbd390f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+9:5821:x1875771241006080:12345-0@lo:503: 00000100:00100000:3.0:1788874932.625507:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbbd390f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+9:5821:x1875771241006080:12345-0@lo:503: Request processed in 318us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874932.625513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874932.625734:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006080:0@lo:503: 00000100:00100000:2.0:1788874932.626868:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5864:1875771241006208:0@lo:502: 00000100:00100000:2.0:1788874932.626929:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874932.626959:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003f960ce going to sleep for 11 seconds 00000100:00100000:0.0:1788874932.628440:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006208 00000100:00100000:0.0:1788874932.628452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006208 00000100:00100000:0.0:1788874932.628513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788874932.628522:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000013152cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+9:5864:x1875771241006208:12345-0@lo:502: 00000100:00100000:0.0:1788874932.628817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000013152cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+9:5864:x1875771241006208:12345-0@lo:502: Request processed in 295us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874932.628824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788874932.633454:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5864:1875771241006208:0@lo:502: 00000020:01000000:2.0:1788874932.633507:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874932.633522:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874932.633525:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788874932.633529:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788874932.633534:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788874932.633565:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003b642619) 00000020:00000080:2.0:1788874932.633590:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788874932.633595:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788874932.633668:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788874932.633687:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d81f5b 00000020:00000080:2.0:1788874932.633916:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788874932.633920:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874932.633923:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874932.633923:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788874932.633925:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874932.633927:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874932.633928:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788874932.633930:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788874932.633935:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000065529c21) 00000020:00000080:2.0:1788874932.633943:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788874932.633946:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788874932.633947:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788874932.633951:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788874932.633956:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788874932.633997:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006987ba8b from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788874932.634008:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a435b5fc) 00000020:00000080:2.0:1788874932.634016:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788874932.634064:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788874932.634069:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d81f70 00000020:00000080:2.0:1788874932.634278:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788874932.634283:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788874932.634292:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x60858e6020d81f77 00080000:01000000:2.0:1788874932.634295:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788874932.634298:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d81f7e 00080000:10000000:2.0:1788874932.634692:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788874932.635322:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788874932.639939:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788874932.704549:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788874932.705065:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788874932.710130:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788874932.711395:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788874932.743242:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002eed4cf2) 00000020:00000080:1.0:1788874932.743267:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788874932.743326:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788874932.743333:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d81f8c 00000020:00000080:3.0:1788874932.745416:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788874932.748138:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874932.802665:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874932.849368:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874932.901477:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788874932.940862:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788874932.977504:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788874933.005382:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x60858e6020d81f93 00010000:00010000:1.0:1788874933.005921:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788874933.006333:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788874933.006352:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788874933.006358:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874933.006360:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788874933.006363:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788874933.006369:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874933.006370:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788874933.006374:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788874933.006428:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788874933.006442:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788874933.006445:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874933.006446:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788874933.006449:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788874933.006451:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874933.006452:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788874933.006455:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788874933.006456:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788874933.006501:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5864:1875771241006336:0@lo:502: 00000100:00100000:1.0:1788874933.006586:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.006654:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000930b846f going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.006823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006336 00000100:00100000:0.0:1788874933.006832:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006336 00000100:00100000:0.0:1788874933.006878:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788874933.006887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9327e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+9:5864:x1875771241006336:12345-0@lo:502: 00000100:00100000:0.0:1788874933.007373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9327e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+9:5864:x1875771241006336:12345-0@lo:502: Request processed in 486us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.007382:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788874933.007657:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5864:1875771241006336:0@lo:502: 00000020:01000000:1.0:1788874933.007687:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788874933.007693:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874933.007695:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788874933.007699:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788874933.008150:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788874933.008170:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788874933.008229:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.008241:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000006cb66438/0x60858e6020d81f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874933.008248:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5a06641800 from 1 10000000:01000000:2.0:1788874933.008251:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788874933.008282:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.008289:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.008296:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.008312:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006464:0@lo:101: 00000100:00100000:2.0:1788874933.008350:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.008386:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.008445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006464 00000100:00100000:0.0:1788874933.008450:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006464 00000100:00100000:0.0:1788874933.008484:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874933.008491:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004de77783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+9:5821:x1875771241006464:12345-0@lo:101: 00010000:00010000:0.0:1788874933.008504:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874933.008517:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81f9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.008552:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81f9a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.008561:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f9a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.008569:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b27cc51, rc 0) 00000100:00100000:0.0:1788874933.008609:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004de77783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+10:5821:x1875771241006464:12345-0@lo:101: Request processed in 118us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.008615:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788874933.008682:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006464:0@lo:101: 00010000:00010000:2.0:1788874933.008702:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.008720:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.009258:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006592:0@lo:256: 00000100:00100000:2.0:1788874933.009297:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.009323:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.009487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006592 00000100:00100000:0.0:1788874933.009493:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006592 00000100:00100000:0.0:1788874933.009521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874933.009528:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af123f88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+10:5821:x1875771241006592:12345-0@lo:256: 20000000:01000000:0.0:1788874933.009542:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788874933.009548:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788874933.009603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af123f88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+10:5821:x1875771241006592:12345-0@lo:256: Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.009609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788874933.009850:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006592:0@lo:256: 10000000:01000000:2.0:1788874933.010528:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788874933.010656:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.010665:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874933.010673:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06641800 from 1 10000000:01000000:2.0:1788874933.010676:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788874933.010715:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.010723:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.010731:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.010748:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006720:0@lo:101: 00000100:00100000:2.0:1788874933.010948:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.010989:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.011047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006720 00000100:00100000:0.0:1788874933.011054:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006720 00000100:00100000:0.0:1788874933.011106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788874933.011114:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088360c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+10:5821:x1875771241006720:12345-0@lo:101: 00010000:00010000:0.0:1788874933.011127:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874933.011140:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81fa8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.011161:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.011178:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.011186:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000235355b4, rc 0) 00000100:00100000:0.0:1788874933.011232:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088360c30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241006720:12345-0@lo:101: Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.011238:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788874933.011428:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006720:0@lo:101: 00010000:00010000:2.0:1788874933.011441:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.011449:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.011494:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006848:0@lo:501: 00000100:00100000:2.0:1788874933.011516:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.011536:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:1.0:1788874933.011586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006848 00000100:00100000:1.0:1788874933.011591:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006848 00000100:00100000:1.0:1788874933.011618:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788874933.011623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000326f7ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241006848:12345-0@lo:501: 00000100:00100000:1.0:1788874933.012351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000326f7ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241006848:12345-0@lo:501: Request processed in 726us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874933.012367:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788874933.012499:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006848:0@lo:501: 00000100:00100000:2.0:1788874933.012531:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006976:0@lo:503: 00000100:00100000:2.0:1788874933.012568:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.012598:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.012678:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241006976 00000100:00100000:0.0:1788874933.012683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241006976 00000100:00100000:0.0:1788874933.012723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788874933.012729:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bacc870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241006976:12345-0@lo:503: 00000040:00080000:0.0:1788874933.012762:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788874933.012820:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bacc870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241006976:12345-0@lo:503: Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.012826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788874933.012953:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241006976:0@lo:503: 00000040:00080000:1.0:1788874933.013922:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788874933.014091:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788874933.014112:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788874933.014416:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.014428:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874933.014472:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788874933.014474:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5a06641800 10000000:01000000:2.0:1788874933.014487:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5a06641800 10000000:01000000:2.0:1788874933.014491:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788874933.014496:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a06641800 from 1 10000000:01000000:2.0:1788874933.014499:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788874933.014528:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.014536:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.014544:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.014563:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007104:0@lo:101: 00000100:00100000:2.0:1788874933.014619:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.014654:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b7d5ae0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.014716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007104 00000100:00100000:0.0:1788874933.014722:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007104 00000100:00100000:0.0:1788874933.014759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788874933.014766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058a0ede1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241007104:12345-0@lo:101: 00010000:00010000:0.0:1788874933.014822:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874933.014833:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bb4ec6d/0x60858e6020d81fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81fb6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.014854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bb4ec6d/0x60858e6020d81fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.014862:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bb4ec6d/0x60858e6020d81fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874933.014875:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bb4ec6d, rc 0) 00000100:00100000:0.0:1788874933.014914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058a0ede1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007104:12345-0@lo:101: Request processed in 149us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.014921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788874933.015060:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002212a4fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007104:0@lo:101: 00010000:00010000:1.0:1788874933.015074:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874933.015092:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874933.015137:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007232:0@lo:501: 00000100:00100000:1.0:1788874933.015175:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.015203:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b863f82 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.015301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007232 00000100:00100000:0.0:1788874933.015305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007232 00000100:00100000:0.0:1788874933.015333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788874933.015339:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd509272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007232:12345-0@lo:501: 00000100:00100000:0.0:1788874933.015591:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd509272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007232:12345-0@lo:501: Request processed in 252us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.015599:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788874933.015716:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007232:0@lo:501: 00000100:00100000:1.0:1788874933.015743:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007360:0@lo:503: 00000100:00100000:1.0:1788874933.015805:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.015820:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b863f82 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.015942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007360 00000100:00100000:0.0:1788874933.015947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007360 00000100:00100000:0.0:1788874933.015970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788874933.015977:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d088ce92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007360:12345-0@lo:503: 00000100:00100000:0.0:1788874933.016432:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d088ce92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007360:12345-0@lo:503: Request processed in 455us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.016439:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788874933.016511:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007360:0@lo:503: 00000100:00100000:1.0:1788874933.016994:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5869:1875771241007488:0@lo:502: 00000100:00100000:1.0:1788874933.017031:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.017065:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb833493 going to sleep for 11 seconds 00000100:00100000:0.0:1788874933.017171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007488 00000100:00100000:0.0:1788874933.017176:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007488 00000100:00100000:0.0:1788874933.017210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788874933.017217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002533fa88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5869:x1875771241007488:12345-0@lo:502: 00000100:00100000:0.0:1788874933.017417:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002533fa88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5869:x1875771241007488:12345-0@lo:502: Request processed in 200us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.017424:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788874933.017530:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5869:1875771241007488:0@lo:502: 00000020:01000004:1.0:1788874933.017591:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788874933.017607:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007ef9073e) 00000020:00000080:1.0:1788874933.017624:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788874933.017804:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006987ba8b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788874933.017814:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006987ba8b from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788874933.017817:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006987ba8b 4 00010000:00080000:1.0:1788874933.017845:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003a1d92fb@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1788874933.020336:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788874933.020605:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788874933.020642:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788874933.020655:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x60858e6020d81fcb 00000100:00080000:0.0:1788874933.020665:0:5869:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788874933.020670:0:5869:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a1d92fb using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788874933.020704:0:5869:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cd8f02bd x1875771241007616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788874933.020805:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd8f02bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241007616:0@lo:38: 00000100:00100000:2.0:1788874933.020891:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788874933.020986:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788874933.022327:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007616 00000100:00100000:0.0:1788874933.022338:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007616 00000100:00100000:0.0:1788874933.022384:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788874933.022390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000427a2291 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875771241007616:12345-0@lo:38: 00000100:00100000:0.0:1788874933.023881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000427a2291 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875771241007616:12345-0@lo:38: Request processed in 1483us (2983us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788874933.023894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874933.024126:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788874933.024135:0:3302:0:(import.c:65:import_set_state_nolock()) 000000003a1d92fb lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788874933.024140:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788874933.024143:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd8f02bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241007616:0@lo:38: 00000100:00100000:1.0:1788874933.026807:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5869:1875771241007744:0@lo:502: 00000100:00100000:1.0:1788874933.026889:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.026929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007744 00000100:00100000:1.0:1788874933.026936:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007744 00000100:00100000:1.0:1788874933.026975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788874933.026983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000885d7329 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5869:x1875771241007744:12345-0@lo:502: 00000100:00100000:1.0:1788874933.027217:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000885d7329 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5869:x1875771241007744:12345-0@lo:502: Request processed in 235us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874933.027226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788874933.027294:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076b46901 going to sleep for 11 seconds 00000100:00100000:1.0:1788874933.027316:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:5869:1875771241007744:0@lo:502: 00000040:00080000:1.0:1788874933.027340:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788874933.027880:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788874933.027901:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788874933.027916:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.027928:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000ee193ac4/0x60858e6020d81fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788874933.027991:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788874933.027993:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874933.027995:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874933.027996:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788874933.027997:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874933.027999:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874933.028000:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874933.028001:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874933.028003:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788874933.028004:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788874933.028005:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874933.028007:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788874933.028011:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788874933.028014:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788874933.028015:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874933.028016:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874933.028017:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788874933.028018:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874933.028019:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874933.028020:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874933.028022:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874933.028022:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788874933.028023:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788874933.028024:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874933.028025:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788874933.028041:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788874933.028053:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f3fa6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007872:0@lo:253: 00000100:00100000:2.0:1788874933.028152:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.028171:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd80310 going to sleep for 11 seconds 00000100:00100000:2.0:1788874933.028190:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241007872 00000100:00100000:2.0:1788874933.028195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241007872 00000100:00100000:2.0:1788874933.028224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788874933.028231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048a4ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5821:x1875771241007872:12345-0@lo:253: 20000000:01000000:2.0:1788874933.028254:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788874933.028271:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788874933.060367:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788874933.060447:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788874933.062427:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788874933.062437:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788874933.062459:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874933.062481:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f9a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874933.062489:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874933.062532:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874933.062548:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 12 pid: 5834 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874933.062581:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241008000:0@lo:104: 00000100:00100000:1.0:1788874933.062653:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874933.062724:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0a8acbd going to sleep for 11 seconds 00000100:00100000:3.0:1788874933.062908:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008000 00000100:00100000:3.0:1788874933.062916:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008000 00000100:00100000:3.0:1788874933.062968:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788874933.062975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7597965 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241008000:12345-0@lo:104: 00010000:00010000:3.0:1788874933.062987:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874933.063058:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788874933.063063:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7597965 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241008000:12345-0@lo:104: Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874933.063071:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788874933.063253:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241008000:0@lo:104: 00010000:00010000:1.0:1788874933.063272:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063412:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874933.063418:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063425:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e2e54f6 already unused, calling callback (000000003ec520ef) 10000000:00010000:2.0:1788874933.063428:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063435:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788874933.063441:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874933.063447:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788874933.063484:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063491:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788874933.063518:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063525:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: 000000005e2e54f6/0x60858e6020d81f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fa1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063541:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874933.063543:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874933.063544:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874933.063591:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788874933.063608:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241008128:0@lo:103: 00000100:00100000:2.0:1788874933.063641:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874933.063691:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008128 00000100:00100000:2.0:1788874933.063695:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008128 00010000:00010000:2.0:1788874933.063725:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 13 pid: 5834 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874933.063746:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874933.063752:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d69a77cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+13:3303:x1875771241008128:12345-0@lo:103: 00010000:00010000:2.0:1788874933.063762:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874933.063765:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 13 pid: 5834 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063798:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 13 pid: 5834 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063811:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004b27cc51/0x60858e6020d81fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81f9a expref: 13 pid: 5834 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063823:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063830:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788874933.063841:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001405125s 00010000:00010000:2.0:1788874933.063844:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063850:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063865:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063870:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063874:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011105e0f already unused, calling callback (00000000ff54563b) 00010000:00010000:2.0:1788874933.063878:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063883:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063895:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063904:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874933.063927:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d69a77cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3303:x1875771241008128:12345-0@lo:103: Request processed in 176us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874933.063934:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874933.063967:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241008128:0@lo:103: 00010000:00010000:2.0:1788874933.063985:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063992:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874933.063996:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011105e0f/0x60858e6020d81fd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874933.070276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048a4ebec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5821:x1875771241007872:12345-0@lo:253: Request processed in 42035us (42115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874933.070291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788874933.070392:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f3fa6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:5821:1875771241007872:0@lo:253: 10000000:01000000:2.0:1788874933.070418:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788874933.070421:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788874933.070423:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788874933.070424:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788874933.070425:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788874933.070426:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788874933.070427:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788874933.070428:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788874933.070429:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788874933.070431:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788874933.070432:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788874933.070433:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788874933.070435:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788874933.070449:0:5821:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788874933.075828:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.076200:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874933.076426:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.076597:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874933.076804:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.076954:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874933.080285:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.080510:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874933.080899:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.081079:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874933.081372:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874933.081558:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788874933.120618:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788874933.146827:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788874933.147294:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788874933.149756:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788874933.149953:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788874933.150432:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788874933.150439:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788874933.150557:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788874933.153422:0:5874:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788874933.153429:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788874933.156676:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788874933.158540:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788874933.158587:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788874933.158982:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788874933.159382:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788874933.160707:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788874933.160901:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788874933.161051:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788874933.161192:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788874933.161354:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788874933.168468:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788874933.168649:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788874933.168850:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788874933.168999:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788874933.169241:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788874933.169379:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788874933.169544:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788874933.169683:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788874933.169861:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788874933.169988:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788874933.170537:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788874933.170933:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788874933.171528:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788874933.171700:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788874933.171868:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788874933.171996:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788874933.174258:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788874933.174469:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788874933.174626:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788874933.175277:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788874933.175471:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788874933.175609:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788874933.175762:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788874933.175945:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788874933.176369:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788874933.176533:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788874933.176680:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788874933.176881:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788874933.190981:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788874933.239419:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788874933.239456:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae1241993988 00100000:10000000:0.0:1788874933.239465:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788874933.240113:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788874933.240129:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788874933.240143:0:5821:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788874933.240174:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788874933.293273:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788874933.293360:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788874933.293364:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788874934.031014:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874935.059181:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874936.078930:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874937.102743:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874938.125946:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788874938.189971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788874938.189979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788874938.189982:0:36:0:(import.c:65:import_set_state_nolock()) 000000003a1d92fb lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788874938.189993:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a1d92fb using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1788874938.190013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000388b9273 x1875771241008384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788874938.190194:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241008256:0@lo:400: 00000100:00100000:2.0:1788874938.190264:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874938.190332:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241008384:0@lo:38: 00000100:00100000:2.0:1788874938.190372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874938.190442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008256 00000100:00100000:1.0:1788874938.190449:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008256 00000100:00100000:1.0:1788874938.190499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788874938.190508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d91f0ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:3305:x1875771241008256:12345-0@lo:400: 00000100:00100000:1.0:1788874938.190569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d91f0ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:3305:x1875771241008256:12345-0@lo:400: Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874938.190577:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788874938.190614:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008384 00000100:00100000:1.0:1788874938.190618:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008384 00000100:00100000:1.0:1788874938.190636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874938.190639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f3fa6e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875771241008384:12345-0@lo:38: 00010000:00080000:1.0:1788874938.190658:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1788874938.190692:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x60858e6020d81fd9 00000004:00100000:1.0:1788874938.190734:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788874938.190892:0:5843:0:(import.c:65:import_set_state_nolock()) 000000001cb8650b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788874938.190933:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f3fa6e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875771241008384:12345-0@lo:38: Request processed in 292us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874938.190939:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788874938.190981:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000388b9273 x1875771241008384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788874948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788874938.190994:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788874938.191000:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788874938.191004:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788874938.191006:0:3302:0:(import.c:65:import_set_state_nolock()) 000000003a1d92fb lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788874938.191010:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241008384:0@lo:38: 00000100:00100000:1.0:1788874938.191106:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241008256:0@lo:400: 00000001:02000400:3.0:1788874938.557846:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788874939.151185:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874940.175033:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874941.200543:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788874941.775181:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788874941.775192:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5a06641800 from 3 10000000:01000000:2.0:1788874941.775197:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788874941.775256:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874941.775268:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874941.775298:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874941.775346:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241008512:0@lo:101: 00000100:00100000:2.0:1788874941.775437:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874941.775503:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008512 00000100:00100000:0.0:1788874941.775514:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008512 00000100:00100000:2.0:1788874941.775582:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000003cf74b3c going to sleep for 11 seconds 00000100:00100000:0.0:1788874941.778508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788874941.778987:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027bc9cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:5838:x1875771241008512:12345-0@lo:101: 00010000:00010000:0.0:1788874941.779079:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874941.779109:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efcfc052/0x60858e6020d81fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81fe0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874941.779145:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efcfc052/0x60858e6020d81fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874941.779156:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efcfc052/0x60858e6020d81fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874941.779165:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efcfc052, rc 0) 00000100:00100000:0.0:1788874941.779272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027bc9cc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241008512:12345-0@lo:101: Request processed in 750us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874941.779279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788874941.779394:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241008512:0@lo:101: 00010000:00010000:2.0:1788874941.779414:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874941.779422:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874941.780130:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241008640:0@lo:256: 00000100:00100000:2.0:1788874941.780179:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874941.780224:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000003cf74b3c going to sleep for 11 seconds 00000100:00100000:1.0:1788874941.780248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008640 00000100:00100000:1.0:1788874941.780512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008640 00000100:00100000:1.0:1788874941.780685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788874941.780695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e135e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241008640:12345-0@lo:256: 20000000:01000000:1.0:1788874941.780729:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788874941.780748:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788874941.780752:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788874941.780921:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e135e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241008640:12345-0@lo:256: Request processed in 228us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874941.780930:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788874941.780951:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2bedea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241008640:0@lo:256: 10000000:01000000:3.0:1788874941.781012:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788874941.781022:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874941.781031:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: 00000000fb921caa/0x60858e6020d81fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874942.226503:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874943.246355:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874943.319823:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241008768:0@lo:400: 00000100:00100000:1.0:1788874943.319937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874943.320036:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788874943.320046:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241008896:0@lo:400: 00000100:00100000:1.0:1788874943.320080:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874943.320128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008768 00000100:00100000:1.0:1788874943.320137:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008768 00000100:00100000:1.0:1788874943.320194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788874943.320204:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048dd50b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:3306:x1875771241008768:12345-0@lo:400: 00000100:00100000:1.0:1788874943.320262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048dd50b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:3306:x1875771241008768:12345-0@lo:400: Request processed in 60us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874943.320270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788874943.320322:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241008896 00000100:00100000:1.0:1788874943.320326:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241008896 00000100:00100000:1.0:1788874943.320355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788874943.320361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dee3c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241008896:12345-0@lo:400: 00000100:00100000:1.0:1788874943.320389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dee3c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241008896:12345-0@lo:400: Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874943.320393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788874943.320423:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecb8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241008768:0@lo:400: 00010000:00080000:1.0:1788874943.320451:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000388b9273 x1875771241008896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874943.320476:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241008896:0@lo:400: 00000020:00000080:0.0:1788874944.125706:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff14b8d050 20000000:00000080:0.0:1788874944.125731:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a05706400 uarg=0000000000000000 20000000:01000000:0.0:1788874944.125882:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788874944.125983:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788874944.125991:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788874944.126265:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788874944.126279:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788874944.131160:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788874944.131497:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788874944.131701:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788874944.131762:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788874944.131878:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788874944.131903:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.131928:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.131937:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.132052:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.132072:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 11 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874944.132100:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875771241009024:0@lo:104: 00000100:00100000:1.0:1788874944.132188:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874944.132806:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1d04d38 going to sleep for 11 seconds 00000100:00100000:0.0:1788874944.133439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009024 00000100:00100000:0.0:1788874944.133451:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009024 00000100:00100000:0.0:1788874944.133674:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788874944.133685:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ecb8a8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:6320:x1875771241009024:12345-0@lo:104: 00010000:00010000:0.0:1788874944.133704:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874944.133830:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788874944.133836:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ecb8a8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:6320:x1875771241009024:12345-0@lo:104: Request processed in 154us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874944.133855:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874944.133957:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875771241009024:0@lo:104: 00010000:00010000:1.0:1788874944.134004:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134140:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874944.134146:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134154:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c292473 already unused, calling callback (000000003ec520ef) 10000000:00010000:2.0:1788874944.134158:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134166:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788874944.134184:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874944.134190:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788874944.134240:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134247:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788874944.134270:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134277:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: 000000009c292473/0x60858e6020d81fa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81faf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134308:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874944.134310:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874944.134311:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874944.134326:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc1303b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241009152:0@lo:103: 00000100:00100000:2.0:1788874944.134370:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874944.134430:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009152 00000100:00100000:2.0:1788874944.134436:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009152 00010000:00010000:2.0:1788874944.134460:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874944.134486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788874944.134493:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a01062 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3304:x1875771241009152:12345-0@lo:103: 00010000:00010000:2.0:1788874944.134507:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874944.134524:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134543:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134558:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000235355b4/0x60858e6020d81faf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81fa8 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134573:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134580:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134595:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134603:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134609:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134614:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134619:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044558a3f already unused, calling callback (00000000ff54563b) 00010000:00010000:2.0:1788874944.134623:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134630:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134650:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874944.134659:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874944.134688:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a01062 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+11:3304:x1875771241009152:12345-0@lo:103: Request processed in 196us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874944.134696:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788874944.134729:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc1303b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241009152:0@lo:103: 00010000:00010000:1.0:1788874944.135088:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.135097:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874944.135103:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044558a3f/0x60858e6020d81fee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874944.270306:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874945.298997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874946.318041:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874947.343070:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874948.367563:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874948.432628:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042a4b8b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241009408:0@lo:400: 00000100:00100000:2.0:1788874948.432740:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874948.432880:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788874948.432886:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba9b598e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241009280:0@lo:400: 00000100:00100000:2.0:1788874948.432921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874948.435438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009280 00000100:00100000:1.0:1788874948.435459:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009280 00000100:00100000:1.0:1788874948.435543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788874948.435555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b709117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+11:3306:x1875771241009280:12345-0@lo:400: 00000100:00100000:1.0:1788874948.435683:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b709117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+11:3306:x1875771241009280:12345-0@lo:400: Request processed in 131us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874948.435692:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788874948.435759:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba9b598e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241009280:0@lo:400: 00000100:00100000:3.0:1788874948.435907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009408 00000100:00100000:3.0:1788874948.435913:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009408 00000100:00100000:3.0:1788874948.435967:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788874948.435973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc1303b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241009408:12345-0@lo:400: 00000100:00100000:3.0:1788874948.436019:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc1303b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241009408:12345-0@lo:400: Request processed in 47us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874948.436026:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788874948.438347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042a4b8b7 x1875771241009408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874948.438371:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042a4b8b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241009408:0@lo:400: 00010000:00010000:3.0:1788874949.393329:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874950.413864:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788874950.478417:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788874950.478429:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06641800 from 1 10000000:01000000:2.0:1788874950.478436:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788874950.478498:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: 0000000027fed2e9/0x60858e6020d81ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874950.478514:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: 0000000027fed2e9/0x60858e6020d81ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874950.478527:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: 0000000027fed2e9/0x60858e6020d81ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874950.478562:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f090d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009536:0@lo:101: 00000100:00100000:2.0:1788874950.478671:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874950.478737:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abc1bd78 going to sleep for 11 seconds 00000100:00100000:1.0:1788874950.479136:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009536 00000100:00100000:1.0:1788874950.479148:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009536 00000100:00100000:1.0:1788874950.479214:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788874950.479224:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006009dd40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:5838:x1875771241009536:12345-0@lo:101: 00010000:00010000:1.0:1788874950.479250:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874950.479276:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b7f748e/0x60858e6020d81ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d81ff5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874950.479313:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b7f748e/0x60858e6020d81ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874950.479326:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b7f748e/0x60858e6020d81ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874950.479337:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b7f748e, rc 0) 00000100:00100000:1.0:1788874950.479395:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006009dd40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241009536:12345-0@lo:101: Request processed in 173us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874950.479402:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788874950.481435:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f090d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009536:0@lo:101: 00010000:00010000:0.0:1788874950.481473:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: 0000000027fed2e9/0x60858e6020d81ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874950.481487:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: 0000000027fed2e9/0x60858e6020d81ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874950.481595:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a208275a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009664:0@lo:501: 00000100:00100000:0.0:1788874950.481668:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874950.481715:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6c41938 going to sleep for 11 seconds 00000100:00100000:0.0:1788874950.481738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009664 00000100:00100000:0.0:1788874950.481745:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009664 00000100:00100000:0.0:1788874950.481819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788874950.481827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b77a560 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241009664:12345-0@lo:501: 00000100:00100000:0.0:1788874950.484865:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b77a560 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241009664:12345-0@lo:501: Request processed in 3029us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874950.484883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788874950.485303:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a208275a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009664:0@lo:501: 00000100:00100000:1.0:1788874950.485387:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009792:0@lo:503: 00000100:00100000:1.0:1788874950.485460:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874950.485511:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d02d402b going to sleep for 11 seconds 00000100:00100000:0.0:1788874950.486675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009792 00000100:00100000:0.0:1788874950.486691:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009792 00000100:00100000:0.0:1788874950.486742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788874950.486752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000022a8193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241009792:12345-0@lo:503: 00000100:00100000:0.0:1788874950.488529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000022a8193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241009792:12345-0@lo:503: Request processed in 1769us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874950.488546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788874950.488803:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000388b9273 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241009792:0@lo:503: 00000100:00100000:0.0:1788874950.493323:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008bf93d2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6663:1875771241009920:0@lo:502: 00000100:00100000:0.0:1788874950.493452:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874950.493522:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035e0038a going to sleep for 11 seconds 00000100:00100000:3.0:1788874950.494293:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241009920 00000100:00100000:3.0:1788874950.494315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241009920 00000100:00100000:3.0:1788874950.494372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788874950.494382:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071fefb8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6663:x1875771241009920:12345-0@lo:502: 00000100:00100000:3.0:1788874950.494718:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071fefb8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6663:x1875771241009920:12345-0@lo:502: Request processed in 336us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874950.494727:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788874950.495583:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008bf93d2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6663:1875771241009920:0@lo:502: 00000020:01000000:2.0:1788874950.495637:0:6663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874950.495652:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874950.495656:0:6663:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788874950.495665:0:6663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a06641800 00000020:00000080:2.0:1788874950.495668:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788874950.495744:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6663:1875771241010048:0@lo:502: 00000100:00100000:2.0:1788874950.495838:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874950.495878:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051b16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788874950.495951:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010048 00000100:00100000:1.0:1788874950.495959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010048 00000100:00100000:1.0:1788874950.496009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788874950.496027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6663:x1875771241010048:12345-0@lo:502: 00000100:00100000:1.0:1788874950.496277:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6663:x1875771241010048:12345-0@lo:502: Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874950.496285:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788874950.497516:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6663:1875771241010048:0@lo:502: 00000020:01000000:2.0:1788874950.497562:0:6663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874950.497571:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874950.497573:0:6663:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788874950.497578:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788874950.498292:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788874950.498323:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788874950.498339:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874950.498354:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.444236:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788874951.459174:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788874951.459178:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788874951.459382:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5a07881000 00000020:01000004:0.0:1788874951.459401:0:6692:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788874951.459413:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788874951.459427:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e5a04930000) 00000020:00000080:0.0:1788874951.459442:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788874951.504407:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788874951.504702:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788874951.525893:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788874951.534887:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788874951.534918:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788874951.534971:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788874951.534997:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788874951.537352:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788874951.537367:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788874951.537380:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x60858e6020d8200a 00000020:01000004:3.0:1788874951.537390:0:6692:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788874951.537413:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788874951.537417:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788874951.537423:0:6692:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788874951.537427:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788874951.537451:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e5a0472cd40) 00000020:00000080:3.0:1788874951.537466:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788874951.540718:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874951.541334:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788874951.541489:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788874951.559318:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788874951.559341:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788874951.560296:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788874951.560307:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788874951.566339:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874951.566580:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788874951.566586:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788874951.570300:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788874951.570321:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788874951.650498:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788874951.651159:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788874951.651167:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788874951.655729:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788874951.655752:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788874951.659815:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788874951.659833:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788874951.677291:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874951.677490:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788874951.677496:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788874951.680409:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788874951.680424:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788874951.823476:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788874951.823897:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788874951.823902:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788874951.825948:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788874951.825963:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788874951.830414:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788874951.830453:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788874951.830461:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788874951.895900:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788874951.895943:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788874951.895948:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788874951.895950:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788874951.895951:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788874951.895952:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788874951.895954:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788874951.895955:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788874951.895956:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788874951.895958:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788874951.895959:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788874951.895961:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788874951.895962:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788874951.895967:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788874951.895969:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788874951.895971:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788874951.895972:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788874951.895973:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788874951.895974:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788874951.895975:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788874951.895976:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788874951.895977:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788874951.895978:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788874951.895979:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788874951.895980:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788874951.896021:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788874951.896046:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241010176:0@lo:253: 00000100:00100000:0.0:1788874951.896131:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.896196:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a069b8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788874951.896538:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010176 00000100:00100000:1.0:1788874951.896546:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010176 00000100:00100000:1.0:1788874951.896601:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788874951.896611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241010176:12345-0@lo:253: 20000000:01000000:1.0:1788874951.896639:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788874951.896643:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788874951.896648:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788874951.896652:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788874951.897881:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788874951.898123:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788874951.898138:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788874951.898179:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788874951.898188:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788874951.898230:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788874951.898282:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788874951.899698:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788874951.899726:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:1.0:1788874951.899728:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:1.0:1788874951.899766:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788874951.902049:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788874951.902260:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788874951.902271:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:1.0:1788874951.902304:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788874951.902312:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788874951.902370:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788874951.902455:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788874951.903947:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788874951.903978:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:1.0:1788874951.903981:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:1.0:1788874951.904026:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788874951.904052:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788874951.904084:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788874951.904091:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:1.0:1788874951.904130:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788874951.904138:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788874951.904165:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788874951.904276:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788874951.904296:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788874951.904299:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788874951.904305:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788874951.904307:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788874951.904309:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788874951.904322:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788874951.904325:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788874951.904436:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788874951.904507:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788874951.906096:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788874951.906175:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788874951.906331:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788874951.907043:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788874951.907090:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788874951.907412:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788874951.907431:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788874951.907434:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788874951.912081:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788874951.912179:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788874951.912258:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788874951.914864:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788874951.914920:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788874951.914956:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788874951.914972:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788874951.914975:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788874951.918338:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788874951.918600:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788874951.918644:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788874951.918718:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1788874951.918738:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788874951.918758:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918806:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f2a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918816:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81f46 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918831:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918839:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918882:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.918897:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.918912:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010304:0@lo:104: 00000100:00100000:1.0:1788874951.918984:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788874951.919040:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.919050:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 12 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.919059:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010432:0@lo:104: 00000100:00100000:1.0:1788874951.919082:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788874951.919109:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.919117:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 12 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.919126:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010560:0@lo:104: 00000100:00100000:1.0:1788874951.919155:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874951.919167:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788874951.919551:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010304 00000100:00100000:0.0:1788874951.919560:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010304 00000100:00100000:0.0:1788874951.919613:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010432 00000100:00100000:0.0:1788874951.919616:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010432 00000100:00100000:0.0:1788874951.919626:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010560 00000100:00100000:0.0:1788874951.919629:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010560 00000100:00100000:0.0:1788874951.919642:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874951.919649:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+5:5833:x1875771241010304:12345-0@lo:104: 00010000:00010000:0.0:1788874951.919663:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.919730:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788874951.919736:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+5:5833:x1875771241010304:12345-0@lo:104: Request processed in 87us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.919743:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874951.919759:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874951.919765:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241010432:12345-0@lo:104: 00010000:00010000:0.0:1788874951.919794:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.919837:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788874951.919843:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241010432:12345-0@lo:104: Request processed in 78us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.919849:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874951.919862:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788874951.919870:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241010560:12345-0@lo:104: 00010000:00010000:0.0:1788874951.919886:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.919914:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788874951.919919:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241010560:12345-0@lo:104: Request processed in 52us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.919926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788874951.919945:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788874951.919951:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.919958:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eaa00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874951.919962:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.919971:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874951.919978:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874951.919983:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874951.920015:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920022:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874951.920040:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920047:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d81fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fbd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920070:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788874951.920074:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920079:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874951.920083:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920090:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874951.920097:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874951.920103:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874951.920117:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920124:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874951.920129:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920135:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26200/0x60858e6020d81f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f4d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920145:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874951.920148:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920163:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027ea000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874951.920166:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920172:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874951.920178:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874951.920182:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874951.920196:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920201:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874951.920217:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920235:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d81f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81f31 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920250:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874951.920252:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874951.920254:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874951.920277:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241010688:0@lo:103: 00000100:00100000:0.0:1788874951.920314:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.920340:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788874951.920345:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241010816:0@lo:103: 00000100:00100000:0.0:1788874951.920682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.920717:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241010944:0@lo:103: 00000100:00100000:0.0:1788874951.920738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.920797:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010688 00000100:00100000:0.0:1788874951.920802:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010688 00010000:00010000:0.0:1788874951.920824:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874951.920839:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010816 00000100:00100000:0.0:1788874951.920842:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010816 00010000:00010000:0.0:1788874951.920852:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 14 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874951.920863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241010944 00000100:00100000:0.0:1788874951.920866:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241010944 00010000:00010000:0.0:1788874951.920876:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 15 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874951.920887:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874951.920894:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+15:3303:x1875771241010688:12345-0@lo:103: 00010000:00010000:0.0:1788874951.920904:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874951.920909:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 15 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920920:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 15 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.920937:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874951.920969:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+15:3303:x1875771241010688:12345-0@lo:103: Request processed in 75us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.920985:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874951.920999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874951.921005:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+14:3303:x1875771241010816:12345-0@lo:103: 00010000:00010000:0.0:1788874951.921012:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874951.921015:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 14 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921024:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 14 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921033:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874951.921055:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+14:3303:x1875771241010816:12345-0@lo:103: Request processed in 51us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.921062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874951.921074:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788874951.921079:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+13:3305:x1875771241010944:12345-0@lo:103: 00010000:00010000:0.0:1788874951.921099:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874951.921104:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 13 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921114:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 13 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921126:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921133:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921157:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921165:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921172:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921179:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921184:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788874951.921201:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921210:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921226:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.921238:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874951.921266:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+13:3305:x1875771241010944:12345-0@lo:103: Request processed in 187us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.921272:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788874951.921312:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241010944:0@lo:103: 00000100:00100000:0.0:1788874951.921336:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241010816:0@lo:103: 00010000:00010000:1.0:1788874951.921836:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030200/0x60858e6020d81fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81fb6 expref: 12 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.921850:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010304:0@lo:104: 00010000:00010000:1.0:1788874951.921860:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d81f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81f46 expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.921868:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010432:0@lo:104: 00010000:00010000:1.0:1788874951.921876:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030800/0x60858e6020d81f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81f2a expref: 10 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.921884:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241010560:0@lo:104: 00010000:00010000:1.0:1788874951.921903:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.921912:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.921918:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.921924:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27000/0x60858e6020d82018 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788874951.921939:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788874951.922039:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241010688:0@lo:103: 00010000:00010000:0.0:1788874951.922133:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874951.979867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+9:6692:x1875771241010176:12345-0@lo:253: Request processed in 83248us (83726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874951.979882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788874951.980052:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241010176:0@lo:253: 10000000:01000000:0.0:1788874951.980068:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788874951.980072:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788874951.980073:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788874951.980075:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788874951.980076:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788874951.980078:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788874951.980079:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788874951.980081:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788874951.980082:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788874951.980084:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788874951.980085:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788874951.980106:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5a07881000 from lustre-OST0000 10000000:01000000:0.0:1788874951.980131:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788874951.980134:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788874951.980141:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e5a0472b380 local copy 10000000:01000000:0.0:1788874951.980145:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788874951.980181:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.980192:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.980203:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874951.980231:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011072:0@lo:101: 00000100:00100000:0.0:1788874951.980270:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.980328:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a069b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788874951.980514:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011072 00000100:00100000:2.0:1788874951.980520:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011072 00000100:00100000:2.0:1788874951.980564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788874951.980573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+9:6692:x1875771241011072:12345-0@lo:101: 00010000:00010000:2.0:1788874951.980585:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874951.980599:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027eb800/0x60858e6020d82026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8201f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.980625:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027eb800/0x60858e6020d82026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8201f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.980636:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027eb800/0x60858e6020d82026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8201f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.980646:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027eb800, rc 0) 00000100:00100000:2.0:1788874951.980687:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+10:6692:x1875771241011072:12345-0@lo:101: Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874951.980693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788874951.980808:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011072:0@lo:101: 00010000:00010000:3.0:1788874951.980821:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.980830:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874951.980963:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011200:0@lo:501: 00000100:00100000:3.0:1788874951.980992:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874951.981023:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082180 going to sleep for 11 seconds 00000100:00100000:0.0:1788874951.981143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011200 00000100:00100000:0.0:1788874951.981148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011200 00000100:00100000:0.0:1788874951.981193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788874951.981200:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+10:6692:x1875771241011200:12345-0@lo:501: 00000100:00100000:0.0:1788874951.981602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+10:6692:x1875771241011200:12345-0@lo:501: Request processed in 402us (608us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788874951.981610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788874951.981726:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011200:0@lo:501: 10000000:01000000:1.0:1788874951.981742:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788874951.981803:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788874951.981810:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.981819:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.981826:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.981843:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788874951.981864:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5a07881000 10000000:01000000:1.0:1788874951.981868:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788874951.981873:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e5a0472b380 10000000:01000000:1.0:1788874951.981876:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788874951.981879:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e5a0472b380 from 1 10000000:01000000:1.0:1788874951.981883:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788874951.981968:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.981977:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.981986:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.982000:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011328:0@lo:101: 00000100:00100000:1.0:1788874951.982028:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874951.982047:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788874951.982114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011328 00000100:00100000:2.0:1788874951.982120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011328 00000100:00100000:2.0:1788874951.982143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788874951.982149:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+10:6692:x1875771241011328:12345-0@lo:101: 00010000:00010000:2.0:1788874951.982158:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874951.982170:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027ebc00/0x60858e6020d82034 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8202d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.982186:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027ebc00/0x60858e6020d82034 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8202d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.982195:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027ebc00/0x60858e6020d82034 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8202d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874951.982203:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027ebc00, rc 0) 00000100:00100000:2.0:1788874951.982247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011328:12345-0@lo:101: Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874951.982253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788874951.982818:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011328:0@lo:101: 00010000:00010000:1.0:1788874951.982847:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.982856:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874951.982874:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788874951.982895:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983084:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874951.983092:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983106:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874951.983110:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983120:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874951.983127:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874951.983133:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874951.983158:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983163:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874951.983181:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983188:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d8201f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d82026 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.983209:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874951.983211:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874951.983213:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874951.983235:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241011456:0@lo:103: 00000100:00100000:3.0:1788874951.983276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874951.983337:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011456 00010000:00010000:1.0:1788874951.983712:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874951.983723:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788874951.983729:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788874951.983735:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788874951.983738:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788874951.983759:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.983765:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.983794:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.983808:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011584:0@lo:101: 00000100:00100000:1.0:1788874951.983839:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874951.983854:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788874951.984007:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011584 00000100:00100000:0.0:1788874951.984014:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011584 00000100:00100000:0.0:1788874951.984051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788874951.984060:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011584:12345-0@lo:101: 00010000:00010000:0.0:1788874951.984072:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874951.984085:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8203b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.984105:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8203b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.984115:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8203b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874951.984123:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030200, rc 0) 00000100:00100000:0.0:1788874951.984162:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241011584:12345-0@lo:101: Request processed in 103us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.984170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788874951.984263:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011456 00000100:00100000:3.0:1788874951.984304:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788874951.984322:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3306:x1875771241011456:12345-0@lo:103: 00010000:00010000:3.0:1788874951.984333:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874951.984435:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027eb800/0x60858e6020d82026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8201f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874951.984457:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874951.984490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+11:3306:x1875771241011456:12345-0@lo:103: Request processed in 170us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874951.984497:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788874951.984536:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241011456:0@lo:103: 00000100:00100000:1.0:1788874951.984857:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011584:0@lo:101: 00010000:00010000:1.0:1788874951.984880:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874951.984890:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874951.985164:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011712:0@lo:501: 00000100:00100000:1.0:1788874951.985216:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874951.985259:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788874951.987835:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011712 00000100:00100000:0.0:1788874951.987851:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011712 00000100:00100000:0.0:1788874951.987932:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788874951.987943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011712:12345-0@lo:501: 00000100:00100000:0.0:1788874951.988281:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011712:12345-0@lo:501: Request processed in 340us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874951.988298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788874951.988711:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011712:0@lo:501: 00000100:00100000:1.0:1788874951.988769:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011840:0@lo:503: 00000100:00100000:1.0:1788874951.988860:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874951.988892:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788874951.988973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011840 00000100:00100000:3.0:1788874951.988979:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011840 00000100:00100000:3.0:1788874951.989011:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788874951.989020:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011840:12345-0@lo:503: 00000100:00100000:3.0:1788874951.989203:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011840:12345-0@lo:503: Request processed in 183us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874951.989211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788874951.989644:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011840:0@lo:503: 00000040:00080000:0.0:1788874951.994121:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788874951.994267:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011968:0@lo:502: 00000100:00100000:0.0:1788874951.994437:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.994636:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a069b8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874951.996911:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241011968 00000100:00100000:2.0:1788874951.996929:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241011968 00000100:00100000:2.0:1788874951.997007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788874951.997017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011968:12345-0@lo:502: 00000100:00100000:2.0:1788874951.997300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241011968:12345-0@lo:502: Request processed in 284us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874951.997308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788874951.997737:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241011968:0@lo:502: 00000040:00080000:0.0:1788874951.998126:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788874951.998189:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788874951.998239:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788874951.998289:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788874951.998328:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788874951.998638:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788874951.998685:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012096:0@lo:502: 00000100:00100000:0.0:1788874951.998749:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874951.998876:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a069b8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874951.999675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012096 00000100:00100000:2.0:1788874951.999685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012096 00000100:00100000:2.0:1788874951.999981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788874951.999993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241012096:12345-0@lo:502: 00000100:00100000:2.0:1788874952.000304:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241012096:12345-0@lo:502: Request processed in 313us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874952.000312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788874952.000578:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012096:0@lo:502: 00000040:00080000:0.0:1788874952.000734:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788874952.000749:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788874952.001612:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788874952.001624:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788874952.001632:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874952.001634:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788874952.001642:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788874952.001658:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e5a04728000) 00000020:00000080:3.0:1788874952.001680:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788874952.001686:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788874952.001768:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a07881000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788874952.001853:0:6711:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788874952.001859:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x60858e6020d82050 00010000:00010000:3.0:1788874952.010823:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788874952.011260:0:6711:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788874952.014540:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788874952.014938:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788874952.025212:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788874952.025757:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788874952.027526:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788874952.027539:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788874952.027546:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874952.027549:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788874952.027553:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788874952.027557:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874952.027558:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788874952.027561:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788874952.027570:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788874952.027625:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788874952.027629:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874952.027631:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788874952.027635:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788874952.034111:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788874952.034159:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788874952.034181:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034195:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874952.034205:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a07881000 from 1 10000000:01000000:2.0:1788874952.034208:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788874952.034262:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034271:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034283:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874952.034309:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012224:0@lo:101: 00000100:00100000:2.0:1788874952.034389:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.034439:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1813a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874952.034474:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012224 00000100:00100000:2.0:1788874952.034482:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012224 00000100:00100000:2.0:1788874952.034525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788874952.034534:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:6692:x1875771241012224:12345-0@lo:101: 00010000:00010000:2.0:1788874952.034565:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874952.034579:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82057 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034603:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82057 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034614:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82057 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034622:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027ebe00, rc 0) 00000100:00100000:2.0:1788874952.034659:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012224:12345-0@lo:101: Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874952.034667:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788874952.034740:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012224:0@lo:101: 00010000:00010000:2.0:1788874952.034755:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874952.034765:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874952.034895:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012352:0@lo:501: 00000100:00100000:2.0:1788874952.035182:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.035253:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a045cfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874952.041026:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012352 00000100:00100000:0.0:1788874952.041043:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012352 00000100:00100000:0.0:1788874952.041098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788874952.041111:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012352:12345-0@lo:501: 00000100:00100000:0.0:1788874952.041723:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012352:12345-0@lo:501: Request processed in 614us (6539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.041733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788874952.045400:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012352:0@lo:501: 00000100:00100000:0.0:1788874952.045636:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012480:0@lo:503: 00000100:00100000:0.0:1788874952.045724:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874952.045839:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0787f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788874952.045922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012480 00000100:00100000:3.0:1788874952.045930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012480 00000100:00100000:3.0:1788874952.045978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788874952.045988:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012480:12345-0@lo:503: 00000100:00100000:3.0:1788874952.046255:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012480:12345-0@lo:503: Request processed in 268us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874952.046264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788874952.046634:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012480:0@lo:503: 00000040:00080000:1.0:1788874952.046982:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788874952.047056:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012608:0@lo:502: 00000100:00100000:1.0:1788874952.047104:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.047137:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874952.047265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012608 00000100:00100000:0.0:1788874952.047271:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012608 00000100:00100000:0.0:1788874952.047307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788874952.047315:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012608:12345-0@lo:502: 00000100:00100000:0.0:1788874952.047495:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012608:12345-0@lo:502: Request processed in 180us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.047502:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788874952.047699:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012608:0@lo:502: 00000040:00080000:1.0:1788874952.048133:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788874952.048181:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788874952.048207:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012736:0@lo:502: 00000100:00100000:1.0:1788874952.048258:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.048287:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874952.048379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012736 00000100:00100000:3.0:1788874952.048385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012736 00000100:00100000:3.0:1788874952.048415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788874952.048422:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012736:12345-0@lo:502: 00000100:00100000:3.0:1788874952.048805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012736:12345-0@lo:502: Request processed in 382us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874952.048814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788874952.049091:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012736:0@lo:502: 00000040:00080000:1.0:1788874952.049201:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788874952.049213:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788874952.050995:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788874952.051009:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874952.051012:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788874952.051019:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a07881000 00000020:00000080:3.0:1788874952.051022:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788874952.051042:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874952.051045:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874952.051047:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788874952.051050:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788874952.051186:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788874952.051214:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788874952.051239:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.051251:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874952.051300:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788874952.051304:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5a07881000 10000000:01000000:1.0:1788874952.051307:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5a07881000 10000000:01000000:1.0:1788874952.051312:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788874952.051317:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a07881000 from 1 10000000:01000000:1.0:1788874952.051319:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788874952.051360:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.051369:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.051381:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874952.051404:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012864:0@lo:101: 00000100:00100000:1.0:1788874952.051470:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.051516:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788874952.051627:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012864 00000100:00100000:0.0:1788874952.051635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012864 00000100:00100000:0.0:1788874952.051683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788874952.051692:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:6692:x1875771241012864:12345-0@lo:101: 00010000:00010000:0.0:1788874952.051705:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874952.051719:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82065 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.051754:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.051765:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.051803:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030400, rc 0) 00000100:00100000:0.0:1788874952.051844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241012864:12345-0@lo:101: Request processed in 153us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.051851:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788874952.051952:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012864:0@lo:101: 00010000:00010000:1.0:1788874952.051973:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.051982:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874952.052070:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012992:0@lo:501: 00000100:00100000:1.0:1788874952.052096:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.052124:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788874952.052191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241012992 00000100:00100000:0.0:1788874952.052196:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241012992 00000100:00100000:0.0:1788874952.052237:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788874952.052245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241012992:12345-0@lo:501: 00000100:00100000:0.0:1788874952.052433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241012992:12345-0@lo:501: Request processed in 189us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.052438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788874952.052533:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241012992:0@lo:501: 00000100:00100000:1.0:1788874952.052561:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013120:0@lo:503: 00000100:00100000:1.0:1788874952.052600:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.052618:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788874952.052656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013120 00000100:00100000:0.0:1788874952.052661:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013120 00000100:00100000:0.0:1788874952.052688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788874952.052694:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013120:12345-0@lo:503: 00000100:00100000:0.0:1788874952.052866:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013120:12345-0@lo:503: Request processed in 172us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.052870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788874952.052937:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013120:0@lo:503: 00000040:00080000:2.0:1788874952.053153:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788874952.053207:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013248:0@lo:502: 00000100:00100000:2.0:1788874952.053252:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.053281:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a045cfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874952.053409:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013248 00000100:00100000:3.0:1788874952.053414:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013248 00000100:00100000:3.0:1788874952.053432:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788874952.053437:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013248:12345-0@lo:502: 00000100:00100000:3.0:1788874952.053564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013248:12345-0@lo:502: Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874952.053571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788874952.053707:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013248:0@lo:502: 00000040:00080000:2.0:1788874952.053937:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788874952.053970:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788874952.053987:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788874952.054022:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788874952.054044:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788874952.054068:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788874952.054085:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788874952.054112:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788874952.054137:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788874952.054167:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788874952.054187:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788874952.054263:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788874952.054293:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788874952.054310:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788874952.054348:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788874952.054386:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788874952.054417:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788874952.054446:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788874952.054463:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788874952.054479:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788874952.054504:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788874952.054522:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788874952.054547:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788874952.054610:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788874952.054639:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788874952.054674:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788874952.054724:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788874952.054793:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788874952.054826:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013376:0@lo:502: 00000100:00100000:2.0:1788874952.054881:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.054908:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a045cfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874952.055465:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013376 00000100:00100000:3.0:1788874952.055471:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013376 00000100:00100000:3.0:1788874952.055513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788874952.055518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013376:12345-0@lo:502: 00000100:00100000:3.0:1788874952.055719:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013376:12345-0@lo:502: Request processed in 199us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874952.055726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788874952.056298:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013376:0@lo:502: 00000040:00080000:2.0:1788874952.056392:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788874952.056405:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788874952.057429:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788874952.057445:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e5a362bcd40) 00000020:00000080:2.0:1788874952.057466:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788874952.057558:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a07881000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788874952.057562:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a07881000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788874952.057564:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a07881000 3 00010000:00080000:2.0:1788874952.057592:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5904e8f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.107@tcp at head 00010000:00010000:2.0:1788874952.061482:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788874952.061697:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788874952.061743:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788874952.061758:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x60858e6020d8207a 00000100:00080000:2.0:1788874952.061798:0:6716:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788874952.061806:0:6716:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5904e8f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1788874952.061843:0:6716:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a34ee3800 x1875771241013504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788874952.061870:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788874952.063038:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241013504:0@lo:38: 00000100:00100000:3.0:1788874952.063118:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.063296:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788874952.063307:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241013632:0@lo:400: 00000100:00100000:2.0:1788874952.063339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874952.063378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013504 00000100:00100000:2.0:1788874952.063387:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013504 00000100:00100000:2.0:1788874952.063426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013632 00000100:00100000:2.0:1788874952.063429:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013632 00000100:00100000:2.0:1788874952.063450:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874952.063456:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241013632:12345-0@lo:400: 00000100:00100000:2.0:1788874952.063500:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241013632:12345-0@lo:400: Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874952.063504:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874952.063516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874952.063519:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875771241013504:12345-0@lo:38: 00010000:00080000:2.0:1788874952.063539:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1788874952.063574:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x60858e6020d82081 00000004:00100000:2.0:1788874952.063588:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788874952.063617:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e5a3c5b9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788874952.063654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875771241013504:12345-0@lo:38: Request processed in 132us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874952.063662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788874952.063698:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a34ee0e00 x1875771241013632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874952.063712:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241013632:0@lo:400: 00010000:00080000:2.0:1788874952.063745:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a34ee3800 x1875771241013504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788874962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874952.063753:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788874952.063759:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788874952.063766:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788874952.063788:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788874952.063791:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5904e8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788874952.063800:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241013504:0@lo:38: 00000040:00080000:1.0:1788874952.067684:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788874952.067872:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788874952.067914:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788874952.067935:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.067957:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788874952.068006:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788874952.068008:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788874952.068010:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788874952.068011:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788874952.068012:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788874952.068013:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788874952.068015:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788874952.068016:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788874952.068017:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788874952.068019:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788874952.068020:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788874952.068025:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788874952.068027:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788874952.068028:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788874952.068030:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788874952.068030:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788874952.068031:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788874952.068032:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788874952.068033:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788874952.068034:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788874952.068035:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788874952.068036:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788874952.068036:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788874952.068064:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788874952.068083:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013760:0@lo:253: 00000100:00100000:0.0:1788874952.068154:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874952.068203:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0787fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874952.068403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013760 00000100:00100000:1.0:1788874952.068411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013760 00000100:00100000:1.0:1788874952.068458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788874952.068468:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013760:12345-0@lo:253: 20000000:01000000:1.0:1788874952.068496:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788874952.068510:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788874952.095663:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788874952.095682:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788874952.097791:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788874952.097801:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788874952.097825:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.097845:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.097854:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.097924:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874952.097939:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874952.097954:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241013888:0@lo:104: 00000100:00100000:1.0:1788874952.098021:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874952.098136:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874952.100792:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:6692:x1875771241013760:12345-0@lo:253: Request processed in 32292us (32604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874952.100809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788874952.100946:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:6692:1875771241013760:0@lo:253: 10000000:01000000:1.0:1788874952.100964:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788874952.100968:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788874952.100970:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788874952.100972:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788874952.100973:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788874952.100975:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788874952.100976:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788874952.100978:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788874952.100979:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788874952.100981:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788874952.100983:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788874952.100984:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788874952.101002:0:6692:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788874952.103012:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241013888 00000100:00100000:0.0:1788874952.103027:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241013888 00000100:00100000:0.0:1788874952.104156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874952.104172:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241013888:12345-0@lo:104: 00010000:00010000:0.0:1788874952.104207:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.104318:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788874952.104324:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241013888:12345-0@lo:104: Request processed in 158us (6304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.104332:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788874952.104405:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241013888:0@lo:104: 00010000:00010000:3.0:1788874952.104431:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.108010:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874952.108025:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.108037:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb400 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874952.108042:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.108054:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874952.108062:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874952.108069:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874952.109048:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109057:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874952.109090:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109098:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb400/0x60858e6020d81fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81fe7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874952.109129:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874952.109131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874952.109142:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788874952.109164:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241014016:0@lo:103: 00000100:00100000:0.0:1788874952.109260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874952.109324:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014016 00000100:00100000:0.0:1788874952.109332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014016 00010000:00010000:0.0:1788874952.109359:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874952.109390:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874952.109399:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+13:3303:x1875771241014016:12345-0@lo:103: 00010000:00010000:0.0:1788874952.109412:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874952.109417:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109429:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109443:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d81fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81fe0 expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109458:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109467:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788874952.109493:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011692244s 00010000:00010000:0.0:1788874952.109498:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109505:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109511:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109519:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109525:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788874952.109529:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109537:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109553:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109563:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874952.109603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+12:3303:x1875771241014016:12345-0@lo:103: Request processed in 205us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874952.109612:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874952.109684:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241014016:0@lo:103: 00010000:00010000:0.0:1788874952.109707:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109722:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874952.109730:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26c00/0x60858e6020d82088 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788874952.111419:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874952.111695:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788874952.114000:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874952.114393:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788874952.115680:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788874952.116164:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788874952.121415:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788874952.420762:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788874952.420793:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788874952.420836:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788874952.420990:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788874952.421012:0:6692:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788874952.421039:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788874952.465191:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874953.489720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874954.523301:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874955.535210:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874956.559258:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788874956.627333:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788874956.627343:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a06641800 from 21 10000000:01000000:2.0:1788874956.627349:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788874956.627403:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.627416:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.627428:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.627450:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014144:0@lo:101: 00000100:00100000:2.0:1788874956.627519:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.627575:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.628108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014144 00000100:00100000:1.0:1788874956.628121:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014144 00000100:00100000:1.0:1788874956.628231:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788874956.628241:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241014144:12345-0@lo:101: 00010000:00010000:1.0:1788874956.628257:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874956.628272:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8208f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874956.628298:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8208f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874956.628310:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8208f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874956.628319:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27600, rc 0) 00000100:00100000:1.0:1788874956.628378:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014144:12345-0@lo:101: Request processed in 139us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.628385:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788874956.628465:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014144:0@lo:101: 00010000:00010000:2.0:1788874956.628482:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.628492:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.628555:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014272:0@lo:501: 00000100:00100000:2.0:1788874956.628583:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.635645:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:0.0:1788874956.636253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014272 00000100:00100000:0.0:1788874956.636265:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014272 00000100:00100000:0.0:1788874956.640542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788874956.640558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014272:12345-0@lo:501: 00000100:00100000:0.0:1788874956.654579:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014272:12345-0@lo:501: Request processed in 14018us (25988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874956.654594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788874956.655061:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014272:0@lo:501: 00000100:00100000:2.0:1788874956.655126:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014400:0@lo:503: 00000100:00100000:2.0:1788874956.655188:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.655235:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.655636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014400 00000100:00100000:1.0:1788874956.655644:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014400 00000100:00100000:1.0:1788874956.655700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788874956.655710:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014400:12345-0@lo:503: 00000100:00100000:1.0:1788874956.657371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014400:12345-0@lo:503: Request processed in 1654us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.657391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788874956.657641:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014400:0@lo:503: 00000100:00100000:3.0:1788874956.659640:0:6896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6896:1875771241014528:0@lo:502: 00000100:00100000:3.0:1788874956.659721:0:6896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874956.659810:0:6896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082000 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.661489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014528 00000100:00100000:1.0:1788874956.661503:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014528 00000100:00100000:1.0:1788874956.661556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788874956.661567:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6896:x1875771241014528:12345-0@lo:502: 00000100:00100000:1.0:1788874956.661944:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:6896:x1875771241014528:12345-0@lo:502: Request processed in 378us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.661952:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788874956.662290:0:6896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6896:1875771241014528:0@lo:502: 00000100:00100000:3.0:1788874956.662367:0:6896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6896:1875771241014656:0@lo:502: 00000100:00100000:3.0:1788874956.662411:0:6896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874956.662444:0:6896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082000 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.665933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014656 00000100:00100000:1.0:1788874956.665949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014656 00000100:00100000:1.0:1788874956.666030:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788874956.666040:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6896:x1875771241014656:12345-0@lo:502: 00000100:00100000:1.0:1788874956.666381:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:6896:x1875771241014656:12345-0@lo:502: Request processed in 341us (3968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.666389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788874956.666868:0:6896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6896:1875771241014656:0@lo:502: 00000040:00080000:3.0:1788874956.666917:0:6896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788874956.667286:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788874956.667314:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788874956.667325:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.667337:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874956.667347:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788874956.667350:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5a06641800 from 4 10000000:01000000:2.0:1788874956.667352:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788874956.667386:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.667395:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.667405:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.667424:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014784:0@lo:101: 00000100:00100000:2.0:1788874956.667471:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.667512:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874956.667558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014784 00000100:00100000:3.0:1788874956.667564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014784 00000100:00100000:3.0:1788874956.667598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788874956.667608:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241014784:12345-0@lo:101: 00010000:00010000:3.0:1788874956.667621:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874956.667638:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8209d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.667661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8209d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.667673:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8209d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.667682:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788874956.667728:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241014784:12345-0@lo:101: Request processed in 121us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.667735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788874956.667817:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014784:0@lo:101: 00010000:00010000:2.0:1788874956.667841:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.667851:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.668165:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014912:0@lo:256: 00000100:00100000:2.0:1788874956.668211:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.668235:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874956.668299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241014912 00000100:00100000:3.0:1788874956.668304:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241014912 00000100:00100000:3.0:1788874956.668337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788874956.668345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241014912:12345-0@lo:256: 20000000:01000000:3.0:1788874956.668360:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788874956.668376:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788874956.668380:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788874956.668458:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241014912:12345-0@lo:256: Request processed in 113us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.668471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788874956.669245:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241014912:0@lo:256: 10000000:01000000:2.0:1788874956.669303:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788874956.669311:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.669321:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874956.669330:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788874956.669332:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788874956.669335:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788874956.669358:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.669366:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.669375:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.669400:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015040:0@lo:101: 00000100:00100000:2.0:1788874956.669433:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.669463:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874956.671144:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015040 00000100:00100000:3.0:1788874956.671159:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015040 00000100:00100000:3.0:1788874956.671225:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788874956.671236:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241015040:12345-0@lo:101: 00010000:00010000:3.0:1788874956.671262:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874956.671284:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d820ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.671311:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d820ab expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.671323:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d820ab expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874956.671332:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788874956.671411:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241015040:12345-0@lo:101: Request processed in 177us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.671418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788874956.672333:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015040:0@lo:101: 00010000:00010000:2.0:1788874956.672357:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.672368:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.672439:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015168:0@lo:501: 00000100:00100000:2.0:1788874956.672484:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.672529:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.672728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015168 00000100:00100000:1.0:1788874956.672734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015168 00000100:00100000:1.0:1788874956.672799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788874956.672808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241015168:12345-0@lo:501: 00000100:00100000:1.0:1788874956.673185:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241015168:12345-0@lo:501: Request processed in 367us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.673194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788874956.673326:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015168:0@lo:501: 00000100:00100000:2.0:1788874956.673359:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015296:0@lo:503: 00000100:00100000:2.0:1788874956.673397:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.673427:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:2.0:1788874956.673441:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015296 00000100:00100000:2.0:1788874956.673444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015296 00000100:00100000:2.0:1788874956.673468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788874956.673474:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241015296:12345-0@lo:503: 00000100:00100000:2.0:1788874956.673750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241015296:12345-0@lo:503: Request processed in 275us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874956.673758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788874956.673815:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241015296:0@lo:503: 00000100:00100000:3.0:1788874956.677444:0:6897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6897:1875771241015424:0@lo:502: 00000100:00100000:3.0:1788874956.677526:0:6897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874956.677576:0:6897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051b1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788874956.678170:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015424 00000100:00100000:2.0:1788874956.678189:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015424 00000100:00100000:2.0:1788874956.678243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788874956.678253:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:6897:x1875771241015424:12345-0@lo:502: 00000100:00100000:2.0:1788874956.678579:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:6897:x1875771241015424:12345-0@lo:502: Request processed in 327us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874956.678587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788874956.679466:0:6897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6897:1875771241015424:0@lo:502: 00000020:01000000:3.0:1788874956.679507:0:6897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788874956.679514:0:6897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788874956.679522:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874956.679524:0:6897:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788874956.679540:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788874956.679545:0:6897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:3.0:1788874956.679568:0:6897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788874956.679570:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788874956.679595:0:6897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e5a3c4819c0) 00000020:00000080:3.0:1788874956.679615:0:6897:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788874956.679621:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788874956.679711:0:6897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788874956.679717:0:6897:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788874956.679723:0:6897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d820c0 00010000:00080000:3.0:1788874956.679751:0:6897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a0495a000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1788874956.682535:0:6897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788874956.747820:0:6897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788874956.747844:0:6897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788874956.748393:0:6897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788874956.748565:0:6897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788874956.748614:0:6897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788874956.748672:0:6897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788874956.749408:0:6899:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788874956.749414:0:6899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788874956.750295:0:6897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788874956.750309:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788874956.750341:0:6897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788874956.750362:0:6897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d820c7 00000100:00080000:2.0:1788874956.750374:0:6897:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788874956.750379:0:6897:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5a0495a000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1788874956.750415:0:6897:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a34ee3800 x1875771241015552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788874956.750485:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241015552:0@lo:8: 00000100:00100000:0.0:1788874956.750555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874956.750654:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015552 00000100:00100000:1.0:1788874956.750662:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015552 00000100:00100000:1.0:1788874956.750701:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788874956.750707:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788874956.750709:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241015552:12345-0@lo:8: 00000100:00100000:3.0:1788874956.750714:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1788874956.750730:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1788874956.750759:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d820ce 00002000:00100000:1.0:1788874956.750803:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e5904edd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788874956.750808:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788874956.750812:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788874956.750933:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788874956.751080:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788874956.751104:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9e5904ede800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788874956.751272:0:6897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788874956.751334:0:6897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874956.751338:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874956.751340:0:6897:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788874956.751343:0:6897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874956.751346:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874956.751347:0:6897:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788874956.751350:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788874956.751358:0:6897:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788874956.751383:0:6897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6897:1875771241015680:0@lo:502: 00000100:00100000:2.0:1788874956.751427:0:6897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.751451:0:6897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a101970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874956.751513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015680 00000100:00100000:2.0:1788874956.751518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015680 00000100:00100000:2.0:1788874956.751546:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788874956.751552:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:6897:x1875771241015680:12345-0@lo:502: 00000100:00100000:2.0:1788874956.751747:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:6897:x1875771241015680:12345-0@lo:502: Request processed in 194us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874956.751755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788874956.751796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241015808:0@lo:400: 00000100:00100000:2.0:1788874956.751817:0:6897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:6897:1875771241015680:0@lo:502: 00000100:00100000:3.0:1788874956.751829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788874956.751840:0:6897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874956.751844:0:6897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874956.751845:0:6897:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788874956.751849:0:6897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1788874956.751850:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788874956.751855:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241015936:0@lo:400: 00000100:00100000:3.0:1788874956.751874:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874956.751902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015808 00000100:00100000:3.0:1788874956.751906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015808 00000020:01000000:2.0:1788874956.751943:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:3.0:1788874956.752023:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241015936 00000100:00100000:3.0:1788874956.752027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241015936 00000100:00100000:3.0:1788874956.752052:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788874956.752058:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241015808:12345-0@lo:400: 00000100:00100000:3.0:1788874956.752096:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241015808:12345-0@lo:400: Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.752102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:2.0:1788874956.752111:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1788874956.752113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788874956.752120:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874956.752125:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241015936:12345-0@lo:400: 00010000:00010000:2.0:1788874956.752131:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874956.752140:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788874956.752143:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e5a0472b380 from 1 10000000:01000000:2.0:1788874956.752145:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1788874956.752153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241015936:12345-0@lo:400: Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.752158:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788874956.752167:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752198:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752206:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.752217:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241016064:0@lo:101: 00000100:00100000:2.0:1788874956.752241:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.752256:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a101970c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788874956.752257:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788874956.752269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016064 00000100:00100000:2.0:1788874956.752272:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016064 00010000:00080000:3.0:1788874956.752276:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee3480 x1875771241015936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874956.752288:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241015936:0@lo:400: 00000100:00100000:2.0:1788874956.752291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788874956.752297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241016064:12345-0@lo:101: 00010000:00080000:3.0:1788874956.752298:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee1c00 x1875771241015808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788874956.752304:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788874956.752305:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241015808:0@lo:400: 00010000:00010000:2.0:1788874956.752316:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d820d5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752338:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752348:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752356:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027eb800, rc 0) 00000100:00100000:2.0:1788874956.752384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241016064:12345-0@lo:101: Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874956.752389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788874956.752417:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241016064:0@lo:101: 00010000:00010000:2.0:1788874956.752436:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752444:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874956.752481:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241016192:0@lo:501: 00000100:00100000:2.0:1788874956.752507:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.752519:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a101970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874956.752529:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016192 00000100:00100000:2.0:1788874956.752533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016192 00000100:00100000:2.0:1788874956.752548:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788874956.752554:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241016192:12345-0@lo:501: 00000100:00100000:2.0:1788874956.752736:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241016192:12345-0@lo:501: Request processed in 181us (228us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788874956.752744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788874956.752791:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241016192:0@lo:501: 10000000:01000000:2.0:1788874956.752809:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788874956.752814:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874956.752820:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874956.754116:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875771241015552:12345-0@lo:8: Request processed in 3400us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.754127:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788874956.754299:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee3800 x1875771241015552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874956.754311:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788874956.754320:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788874956.754329:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788874956.754335:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788874956.754338:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788874956.754353:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788874956.754370:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241015552:0@lo:8: 00000004:00080000:0.0:1788874956.754399:0:6899:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788874956.754528:0:6899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 171619754974ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788874956.817757:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788874956.872219:0:6900:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788874956.872257:0:6900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016448:0@lo:7: 00000100:00100000:1.0:1788874956.872340:0:6900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874956.872395:0:6900:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874956.872420:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016448 00000100:00100000:1.0:1788874956.872426:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016448 00000100:00100000:1.0:1788874956.872489:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874956.872500:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6900:x1875771241016448:12345-0@lo:7: 00000100:00100000:3.0:1788874956.872983:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788874956.872996:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241016320:0@lo:13: 00000100:00100000:3.0:1788874956.873051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788874956.873091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874956.873107:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016320 00000100:00100000:3.0:1788874956.873112:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016320 00000100:00100000:3.0:1788874956.873143:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788874956.873150:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241016320:12345-0@lo:13: 00002000:00000024:3.0:1788874956.873186:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788874956.873235:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241016320:12345-0@lo:13: Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874956.873242:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788874956.873300:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b0700 x1875771241016320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874956.873319:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241016320:0@lo:13: 00002000:00080000:1.0:1788874956.883887:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788874956.883897:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788874956.884011:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6900:x1875771241016448:12345-0@lo:7: Request processed in 11509us (11667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874956.884022:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788874956.884462:0:6900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b3b80 x1875771241016448/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788874972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874956.884481:0:6900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016448:0@lo:7: 00000004:00080000:2.0:1788874956.884506:0:6900:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788874956.884555:0:6900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016576:0@lo:5: 00000100:00100000:2.0:1788874956.884596:0:6900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.890565:0:6900:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a11722600 going to sleep for 11 seconds 00000100:00100000:0.0:1788874956.890846:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016576 00000100:00100000:0.0:1788874956.890927:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016576 00000100:00100000:0.0:1788874956.891057:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874956.891069:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6900:x1875771241016576:12345-0@lo:5: 00002000:00080000:0.0:1788874956.891100:0:6696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788874956.891104:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788874956.891482:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6900:x1875771241016576:12345-0@lo:5: Request processed in 415us (6884us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788874956.891490:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788874956.891594:0:6900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee0e00 x1875771241016576/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874956.891612:0:6900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016576:0@lo:5: 00000004:00080000:2.0:1788874956.891625:0:6900:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788874956.891663:0:6900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016704:0@lo:700: 00000100:00100000:2.0:1788874956.891698:0:6900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874956.891728:0:6900:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a11722600 going to sleep for 11 seconds 00000100:00100000:0.0:1788874956.892030:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016704 00000100:00100000:0.0:1788874956.892037:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016704 00000100:00100000:0.0:1788874956.892076:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788874956.892083:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6900:x1875771241016704:12345-0@lo:700: 00000100:00100000:0.0:1788874956.892116:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875771241016832:0@lo:700: 00000100:00100000:0.0:1788874956.892151:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874956.892243:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a361719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874956.901347:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016832 00000100:00100000:0.0:1788874956.901361:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016832 00000100:00100000:0.0:1788874956.901433:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788874956.901443:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875771241016832:12345-0@lo:700: 40000000:02000000:0.0:1788874956.966405:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788874956.977751:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875771241016832:12345-0@lo:700: Request processed in 76300us (85589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874956.977768:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788874956.980599:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d7100 x1875771241016832/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788874972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874956.980619:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875771241016832:0@lo:700: 40000000:02000000:2.0:1788874956.980636:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788874957.076225:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6900:x1875771241016704:12345-0@lo:700: Request processed in 184133us (184517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874957.076246:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788874957.076307:0:6900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee1180 x1875771241016704/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788874972 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874957.076325:0:6900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016704:0@lo:700: 00000001:00080000:1.0:1788874957.077040:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788874957.077062:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1788874957.145446:0:6900:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788874957.152696:0:6900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016960:0@lo:5: 00000100:00100000:3.0:1788874957.153257:0:6900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874957.153316:0:6900:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0855d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874957.153409:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241016960 00000100:00100000:2.0:1788874957.153417:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241016960 00000100:00100000:2.0:1788874957.153480:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788874957.153490:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6900:x1875771241016960:12345-0@lo:5: 00002000:00080000:3.0:1788874957.167461:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788874957.167482:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788874957.174823:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6900:x1875771241016960:12345-0@lo:5: Request processed in 21328us (22043us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788874957.174836:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788874957.175083:0:6900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a0483fb80 x1875771241016960/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874973 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874957.175098:0:6900:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788874957.175115:0:6900:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e5a0483fb80 x1875771241016960/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874973 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874957.175126:0:6900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6900:1875771241016960:0@lo:5: 00000004:00080000:0.0:1788874957.175140:0:6900:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788874957.587283:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874958.608987:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788874959.606092:0:7064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788874959.637362:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874960.656460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874961.678443:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874962.254028:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788874962.254054:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241017472:0@lo:400: 00000100:00100000:2.0:1788874962.254135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874962.254198:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241017088:0@lo:400: 00000100:00100000:2.0:1788874962.254431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874962.254476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017088 00000100:00100000:2.0:1788874962.254484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017088 00000100:00100000:2.0:1788874962.254528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788874962.254547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241017088:12345-0@lo:400: 00000100:00100000:2.0:1788874962.254604:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241017088:12345-0@lo:400: Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874962.254611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788874962.254983:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017472 00000100:00100000:0.0:1788874962.254988:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017472 00000100:00100000:0.0:1788874962.255037:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788874962.255044:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241017472:12345-0@lo:400: 00000100:00100000:0.0:1788874962.255081:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241017472:12345-0@lo:400: Request processed in 38us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874962.255087:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788874962.255710:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d5500 x1875771241017472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874962.255742:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241017472:0@lo:400: 00000100:00100000:1.0:1788874962.255756:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241017088:0@lo:400: 00000100:00080000:2.0:1788874962.256236:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788874962.256303:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241017216:0@lo:400: 00000100:00100000:2.0:1788874962.256402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874962.256426:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788874962.256432:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241017344:0@lo:400: 00000100:00100000:2.0:1788874962.256449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874962.256483:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017216 00000100:00100000:2.0:1788874962.256487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017216 00000100:00100000:2.0:1788874962.256515:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017344 00000100:00100000:2.0:1788874962.256517:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017344 00000100:00100000:2.0:1788874962.256547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788874962.256553:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241017216:12345-0@lo:400: 00000100:00100000:2.0:1788874962.256593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241017216:12345-0@lo:400: Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874962.256599:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788874962.256611:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788874962.256616:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241017344:12345-0@lo:400: 00000100:00100000:2.0:1788874962.256646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241017344:12345-0@lo:400: Request processed in 30us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874962.256662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788874962.256684:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788874962.256703:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d4e00 x1875771241017344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874962.256713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241017344:0@lo:400: 00010000:00080000:2.0:1788874962.256729:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d7800 x1875771241017216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874962.256737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241017216:0@lo:400: 00000100:00100000:2.0:1788874962.265083:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788874962.265120:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241017600:0@lo:13: 00000100:00100000:2.0:1788874962.265201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874962.265355:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017600 00000100:00100000:1.0:1788874962.265364:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017600 00000100:00100000:1.0:1788874962.265420:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874962.265429:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241017600:12345-0@lo:13: 00002000:00000024:1.0:1788874962.265463:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874962.265514:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241017600:12345-0@lo:13: Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874962.265522:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788874962.265565:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b1f80 x1875771241017600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874962.265583:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241017600:0@lo:13: 00000001:00080000:3.0:1788874962.369968:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788874962.708646:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874963.726163:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874964.754016:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874965.773928:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874966.803201:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874967.374378:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241017856:0@lo:400: 00000100:00100000:1.0:1788874967.374446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874967.374747:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241017984:0@lo:400: 00000100:00100000:0.0:1788874967.374815:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874967.374853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017856 00000100:00100000:0.0:1788874967.374861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017856 00000100:00100000:0.0:1788874967.374916:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017984 00000100:00100000:0.0:1788874967.374920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017984 00000100:00100000:0.0:1788874967.374953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788874967.374963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241017856:12345-0@lo:400: 00000100:00100000:0.0:1788874967.375012:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241017856:12345-0@lo:400: Request processed in 51us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874967.375034:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788874967.375052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788874967.375058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241017984:12345-0@lo:400: 00000100:00100000:0.0:1788874967.375105:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241017984:12345-0@lo:400: Request processed in 47us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874967.375111:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788874967.375126:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788874967.375353:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241017728:0@lo:400: 00000100:00100000:3.0:1788874967.375392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874967.375428:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241018112:0@lo:400: 00000100:00100000:3.0:1788874967.375456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874967.375479:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018112 00000100:00100000:3.0:1788874967.375482:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018112 00000100:00100000:3.0:1788874967.375513:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788874967.375519:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241018112:12345-0@lo:400: 00000100:00100000:3.0:1788874967.375557:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241018112:12345-0@lo:400: Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874967.375564:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788874967.375581:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788874967.375700:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241017728 00000100:00100000:0.0:1788874967.375704:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241017728 00000100:00100000:0.0:1788874967.375738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788874967.375746:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3305:x1875771241017728:12345-0@lo:400: 00000100:00100000:0.0:1788874967.375806:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3305:x1875771241017728:12345-0@lo:400: Request processed in 61us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874967.375812:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788874967.379121:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b0380 x1875771241017856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788874967.379122:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b2a00 x1875771241017984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874967.379154:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241017984:0@lo:400: 00000100:00100000:1.0:1788874967.379156:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241017856:0@lo:400: 00000100:00100000:3.0:1788874967.379278:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241017728:0@lo:400: 00000100:00100000:3.0:1788874967.379291:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241018240:0@lo:13: 00000100:00100000:3.0:1788874967.379353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874967.379646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018240 00000100:00100000:2.0:1788874967.379654:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018240 00000100:00100000:2.0:1788874967.379705:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788874967.379713:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241018240:12345-0@lo:13: 00002000:00000024:2.0:1788874967.379749:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788874967.379814:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241018240:12345-0@lo:13: Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874967.379821:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788874967.380062:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b0000 x1875771241018112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874967.380083:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788874967.380097:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241018112:0@lo:400: 00010000:00080000:3.0:1788874967.381359:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d5c00 x1875771241018240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874967.381379:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241018240:0@lo:13: 00010000:00010000:1.0:1788874967.825401:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874968.851551:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874969.870126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874970.896823:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874971.924956:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874972.495124:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241018368:0@lo:400: 00000100:00100000:1.0:1788874972.495266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.495671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018368 00000100:00100000:3.0:1788874972.495755:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018368 00000100:00100000:0.0:1788874972.496636:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241018752:0@lo:400: 00000100:00100000:0.0:1788874972.496715:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874972.496795:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241018496:0@lo:400: 00000100:00100000:0.0:1788874972.499498:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874972.499575:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788874972.499592:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241018624:0@lo:400: 00000100:00100000:0.0:1788874972.499665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.500278:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241018880:0@lo:13: 00000100:00100000:1.0:1788874972.500469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.500560:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018880 00000100:00100000:1.0:1788874972.500570:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018880 00000100:00100000:1.0:1788874972.500643:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788874972.500657:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241018880:12345-0@lo:13: 00002000:00000024:1.0:1788874972.500703:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874972.500763:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241018880:12345-0@lo:13: Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.500791:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788874972.500839:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874972.502679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788874972.502701:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:3306:x1875771241018368:12345-0@lo:400: 00000100:00100000:3.0:1788874972.503659:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:3306:x1875771241018368:12345-0@lo:400: Request processed in 958us (8385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.503673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788874972.504116:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d7800 x1875771241018880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874972.504154:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241018880:0@lo:13: 00000100:00100000:1.0:1788874972.504185:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241018368:0@lo:400: 00000100:00100000:0.0:1788874972.504568:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018752 00000100:00100000:0.0:1788874972.504580:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018752 00000100:00100000:0.0:1788874972.504645:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874972.504656:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241018752:12345-0@lo:400: 00000100:00100000:0.0:1788874972.504742:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241018752:12345-0@lo:400: Request processed in 89us (8028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.504750:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788874972.504794:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018496 00000100:00100000:0.0:1788874972.504800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018496 00000100:00100000:0.0:1788874972.504843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241018624 00000100:00100000:0.0:1788874972.504848:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241018624 00000100:00100000:0.0:1788874972.504878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788874972.504885:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241018496:12345-0@lo:400: 00000100:00100000:0.0:1788874972.504929:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241018496:12345-0@lo:400: Request processed in 44us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.504936:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788874972.504949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874972.504956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241018624:12345-0@lo:400: 00000100:00100000:0.0:1788874972.504985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241018624:12345-0@lo:400: Request processed in 31us (5321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.504991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788874972.505037:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788874972.505080:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee3100 x1875771241018624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874972.505121:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241018624:0@lo:400: 00010000:00080000:0.0:1788874972.505138:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee0000 x1875771241018496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874972.505147:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241018496:0@lo:400: 00010000:00080000:3.0:1788874972.505931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a34ee2d80 x1875771241018752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874972.505947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241018752:0@lo:400: 00000020:01000004:1.0:1788874972.521422:0:7634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788874972.521429:0:7634:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788874972.521601:0:7634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5904e88000 00000020:01000004:1.0:1788874972.521624:0:7634:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788874972.521640:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788874972.521658:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e5a062399c0) 00000020:00000080:1.0:1788874972.521683:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788874972.547529:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788874972.548145:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788874972.581068:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788874972.589809:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788874972.590046:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788874972.590117:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788874972.590300:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788874972.591987:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788874972.592008:0:7634:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788874972.592036:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x60858e6020d820ea 00000020:01000004:2.0:1788874972.592048:0:7634:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788874972.592081:0:7634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788874972.592086:0:7634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788874972.592094:0:7634:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788874972.592127:0:7634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788874972.592141:0:7634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788874972.619654:0:7634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788874972.619710:0:7634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.107@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788874972.619715:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788874972.619717:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788874972.619718:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788874972.619720:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788874972.619726:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788874972.619727:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788874972.619729:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788874972.619730:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788874972.619731:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788874972.619733:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788874972.619734:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788874972.619739:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788874972.619741:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788874972.619743:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788874972.619744:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788874972.619744:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788874972.619745:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788874972.619746:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788874972.619747:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788874972.619748:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788874972.619749:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788874972.619750:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788874972.619751:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788874972.619900:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788874972.619927:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241019008:0@lo:253: 00000100:00100000:3.0:1788874972.620436:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.620602:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.620683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019008 00000100:00100000:2.0:1788874972.620694:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019008 00000100:00100000:2.0:1788874972.620990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788874972.621003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:7634:x1875771241019008:12345-0@lo:253: 20000000:01000000:2.0:1788874972.621060:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788874972.621066:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788874972.621080:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788874972.621084:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788874972.623541:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788874972.623928:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788874972.623948:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788874972.623994:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788874972.624003:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788874972.624606:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788874972.624684:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788874972.625624:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788874972.625657:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:2.0:1788874972.625660:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:2.0:1788874972.625699:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788874972.625708:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788874972.625761:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788874972.626142:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:2.0:1788874972.626257:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788874972.626463:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788874972.626504:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788874972.626565:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788874972.628433:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788874972.628467:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.107@tcp 20000000:01000000:0.0:1788874972.628469:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.107@tcp (null) (null) (null) 00000040:00080000:0.0:1788874972.628500:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788874972.628508:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788874972.628532:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788874972.628538:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.107@tcp (null) (null) 00000040:00080000:0.0:1788874972.628563:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788874972.628573:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788874972.628610:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788874972.628640:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788874972.628658:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788874972.628662:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788874972.628667:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788874972.628682:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788874972.628685:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788874972.628729:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788874972.628733:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788874972.632348:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788874972.633532:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788874972.633596:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788874972.633702:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788874972.633721:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788874972.633724:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788874972.634747:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788874972.635800:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788874972.635993:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788874972.636560:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788874972.636598:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788874972.636664:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788874972.636678:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788874972.636681:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788874972.637698:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788874972.637924:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788874972.637990:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788874972.638484:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788874972.638522:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788874972.638550:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788874972.638564:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788874972.638568:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788874972.640599:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788874972.640728:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788874972.640897:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788874972.641447:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788874972.641500:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788874972.641580:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788874972.641600:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788874972.641602:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788874972.641619:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788874972.641646:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641671:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641680:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82065 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641688:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8208f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641695:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641703:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641712:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641767:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.641887:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.641907:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019136:0@lo:104: 00000100:00100000:1.0:1788874972.642006:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.642267:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788874972.642288:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019136 00000100:00100000:2.0:1788874972.642297:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019136 00000100:00100000:2.0:1788874972.642364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788874972.642377:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019136:12345-0@lo:104: 00010000:00010000:2.0:1788874972.642395:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.642466:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788874972.642474:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019136:12345-0@lo:104: Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.642481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788874972.642583:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874972.642591:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.642607:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027ea000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788874972.642612:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.642621:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874972.642629:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874972.642635:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788874972.642678:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.642685:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788874972.642708:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.642716:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea000/0x60858e6020d820d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.642733:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874972.642736:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874972.642737:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874972.642752:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241019264:0@lo:103: 00000100:00100000:1.0:1788874972.643258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788874972.643330:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.643360:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.643373:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019392:0@lo:104: 00000100:00100000:1.0:1788874972.643404:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788874972.643443:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.643453:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 16 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.643461:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019520:0@lo:104: 00000100:00100000:1.0:1788874972.643483:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.643514:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019392 00000100:00100000:1.0:1788874972.643521:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019392 00000100:00100000:1.0:1788874972.643553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019520 00000100:00100000:1.0:1788874972.643556:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019520 00000100:00100000:1.0:1788874972.643569:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874972.643578:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241019392:12345-0@lo:104: 00010000:00010000:1.0:1788874972.643593:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.643643:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788874972.643649:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241019392:12345-0@lo:104: Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.643658:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874972.643673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788874972.643679:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019520:12345-0@lo:104: 00010000:00010000:1.0:1788874972.643695:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.643731:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788874972.643737:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019520:12345-0@lo:104: Request processed in 58us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.643743:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788874972.643760:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788874972.643767:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.643806:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eaa00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788874972.643810:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.643933:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019264 00000100:00100000:2.0:1788874972.643939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019264 00010000:00010000:2.0:1788874972.643964:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 17 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.643997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788874972.644004:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+17:3303:x1875771241019264:12345-0@lo:103: 00010000:00010000:2.0:1788874972.644016:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874972.644022:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 17 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.644044:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 17 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.644150:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874972.644263:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+17:3303:x1875771241019264:12345-0@lo:103: Request processed in 259us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.644270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788874972.644459:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241019264:0@lo:103: 00010000:00010000:2.0:1788874972.644489:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788874972.644548:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.644561:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 16 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.644572:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019648:0@lo:104: 00000100:00100000:2.0:1788874972.644603:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788874972.644635:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.644644:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.644653:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019776:0@lo:104: 00000100:00100000:2.0:1788874972.644674:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.644697:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019648 00000100:00100000:2.0:1788874972.644702:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019648 00000100:00100000:2.0:1788874972.644722:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019776 00000100:00100000:2.0:1788874972.644725:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019776 00000100:00100000:2.0:1788874972.644737:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874972.644743:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241019648:12345-0@lo:104: 00010000:00010000:2.0:1788874972.644767:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.645337:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788874972.645346:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:5833:x1875771241019648:12345-0@lo:104: Request processed in 601us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.645355:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874972.645377:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788874972.645385:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019776:12345-0@lo:104: 00010000:00010000:2.0:1788874972.645396:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.645426:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788874972.645431:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5833:x1875771241019776:12345-0@lo:104: Request processed in 49us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.645438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788874972.645490:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876300 going to sleep for 11 seconds 00010000:00010000:2.0:1788874972.645515:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027eb800/0x60858e6020d820dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d820d5 expref: 16 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.645531:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019136:0@lo:104: 00000100:00100000:2.0:1788874972.645543:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019392:0@lo:104: 00000100:00100000:2.0:1788874972.645553:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019520:0@lo:104: 00000100:00100000:2.0:1788874972.645562:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019648:0@lo:104: 00000100:00100000:2.0:1788874972.645569:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875771241019776:0@lo:104: 00010000:00010000:2.0:1788874972.645605:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.645717:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874972.645725:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874972.645732:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788874972.645795:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.645802:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874972.645977:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788874972.646254:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646264:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eaa00/0x60858e6020d820ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646289:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788874972.646295:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646302:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788874972.646305:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646312:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788874972.646319:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874972.646324:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788874972.646342:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646349:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788874972.646368:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646376:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8203b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82042 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.646388:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874972.646391:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874972.646393:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874972.646413:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241020032:0@lo:103: 00010000:00010000:0.0:1788874972.646693:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.646702:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eba00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874972.646705:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.646713:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874972.646720:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874972.646725:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874972.646744:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.646750:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874972.646756:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.646763:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d8208f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82096 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.646893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874972.646895:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874972.646897:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874972.646960:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241019904:0@lo:103: 00000100:00100000:3.0:1788874972.647050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874972.647308:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241019904 00000100:00100000:0.0:1788874972.647319:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241019904 00010000:00010000:0.0:1788874972.647375:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874972.647421:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788874972.647431:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3304:x1875771241019904:12345-0@lo:103: 00010000:00010000:0.0:1788874972.647447:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874972.647452:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.647465:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.647483:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15600/0x60858e6020d820b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d820ab expref: 16 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.647499:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874972.647545:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+15:3304:x1875771241019904:12345-0@lo:103: Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.647551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788874972.647595:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241019904:0@lo:103: 00000100:00100000:1.0:1788874972.647706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.647733:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788874972.647741:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241020160:0@lo:103: 00000100:00100000:1.0:1788874972.647764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.648006:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020032 00000100:00100000:3.0:1788874972.648012:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020032 00010000:00010000:3.0:1788874972.648047:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 15 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874972.648064:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020160 00000100:00100000:3.0:1788874972.648067:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020160 00010000:00010000:3.0:1788874972.648225:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 16 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874972.648242:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788874972.648251:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+16:3305:x1875771241020032:12345-0@lo:103: 00010000:00010000:3.0:1788874972.648261:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874972.648266:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648275:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648288:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030200/0x60858e6020d82042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8203b expref: 16 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648301:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874972.648345:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+15:3305:x1875771241020032:12345-0@lo:103: Request processed in 95us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.648352:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788874972.648370:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788874972.648376:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+14:3305:x1875771241020160:12345-0@lo:103: 00010000:00010000:3.0:1788874972.648384:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874972.648398:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 14 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648407:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 14 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648416:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8208f expref: 14 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.648443:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874972.648466:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+13:3305:x1875771241020160:12345-0@lo:103: Request processed in 90us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.648472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788874972.648761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241020160:0@lo:103: 00000100:00100000:2.0:1788874972.648892:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241020032:0@lo:103: 00010000:00010000:2.0:1788874972.648965:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874972.648968:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874972.648971:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874972.649320:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.649331:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874972.649335:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.649346:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874972.649354:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874972.649359:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874972.649406:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.649414:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788874972.649475:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241020288:0@lo:103: 00000100:00100000:1.0:1788874972.649528:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788874972.649641:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.649649:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26800/0x60858e6020d82065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8206c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.649666:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874972.649669:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874972.649671:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874972.649715:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020288 00000100:00100000:0.0:1788874972.649724:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020288 00010000:00010000:0.0:1788874972.649754:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874972.650037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874972.650048:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+13:3303:x1875771241020288:12345-0@lo:103: 00010000:00010000:0.0:1788874972.650062:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874972.650068:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650240:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650256:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030400/0x60858e6020d8206c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82065 expref: 13 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650274:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650284:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650305:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650314:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650322:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650329:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650348:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788874972.650354:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650363:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.650494:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.650504:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788874972.650513:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1788874972.650707:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650718:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26400/0x60858e6020d820f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.650735:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874972.651021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+12:3303:x1875771241020288:12345-0@lo:103: Request processed in 974us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.651043:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788874972.651195:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241020288:0@lo:103: 00000100:00100000:2.0:1788874972.735377:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+11:7634:x1875771241019008:12345-0@lo:253: Request processed in 114362us (114927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.735400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788874972.736104:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241019008:0@lo:253: 10000000:01000000:1.0:1788874972.736127:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788874972.736131:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788874972.736147:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788874972.736148:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788874972.736149:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788874972.736151:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788874972.736153:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788874972.736155:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788874972.736157:0:7634:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788874972.736159:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788874972.736161:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788874972.736195:0:7634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5904e88000 from lustre-OST0001 10000000:01000000:1.0:1788874972.736238:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788874972.736242:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788874972.736253:0:7634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e5a0472b380 local copy 10000000:01000000:1.0:1788874972.736258:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788874972.736313:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.736326:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.736338:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.736379:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020416:0@lo:101: 00000100:00100000:1.0:1788874972.736446:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.736648:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.736823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020416 00000100:00100000:2.0:1788874972.736833:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020416 00000100:00100000:0.0:1788874972.737119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788874972.737145:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+11:7634:x1875771241020416:12345-0@lo:101: 00010000:00010000:0.0:1788874972.737164:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874972.737186:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00030400/0x60858e6020d820ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d820f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.737219:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00030400/0x60858e6020d820ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d820f8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.737232:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00030400/0x60858e6020d820ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d820f8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.737259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030400, rc 0) 00000100:00100000:0.0:1788874972.737323:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241020416:12345-0@lo:101: Request processed in 193us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.737330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788874972.737563:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020416:0@lo:101: 00010000:00010000:1.0:1788874972.737583:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.737593:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.737749:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020544:0@lo:501: 00000100:00100000:1.0:1788874972.737803:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.737844:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:3.0:1788874972.738020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020544 00000100:00100000:3.0:1788874972.738037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020544 00000100:00100000:3.0:1788874972.738085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788874972.738095:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241020544:12345-0@lo:501: 00000100:00100000:3.0:1788874972.738540:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241020544:12345-0@lo:501: Request processed in 444us (734us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788874972.738549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788874972.738652:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020544:0@lo:501: 10000000:01000000:1.0:1788874972.738669:0:7634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788874972.738715:0:7634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788874972.738722:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.738732:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.738739:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.738802:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788874972.738840:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5904e88000 10000000:01000000:1.0:1788874972.738846:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788874972.738853:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788874972.738855:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788874972.738861:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788874972.738865:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788874972.738895:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.738903:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.739043:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.739063:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020672:0@lo:101: 00000100:00100000:1.0:1788874972.739103:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874972.739236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020672 00000100:00100000:0.0:1788874972.739245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020672 00000100:00100000:0.0:1788874972.739284:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788874972.739294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241020672:12345-0@lo:101: 00010000:00010000:0.0:1788874972.739307:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874972.739325:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82106 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.739353:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82106 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.739365:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82106 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.739375:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030200, rc 0) 00000100:00100000:0.0:1788874972.739404:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241020672:12345-0@lo:101: Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.739411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788874972.739477:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.739494:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020672:0@lo:101: 00010000:00010000:1.0:1788874972.739507:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.739515:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874972.739596:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020800:0@lo:501: 00000100:00100000:1.0:1788874972.739642:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.739703:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00010000:00010000:3.0:1788874972.739808:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874972.739817:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.739826:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874972.739830:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.739839:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874972.739848:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874972.739854:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874972.739889:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.739896:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874972.739928:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.739936:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d820f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x60858e6020d820ff expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.739954:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874972.739956:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874972.739958:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874972.739972:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020800 00000100:00100000:3.0:1788874972.739976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020800 00000100:00100000:3.0:1788874972.740002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788874972.740009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241020800:12345-0@lo:501: 00000100:00100000:3.0:1788874972.740415:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241020800:12345-0@lo:501: Request processed in 405us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.740423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788874972.740600:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241020928:0@lo:103: 00000100:00100000:1.0:1788874972.740647:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.740741:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241020800:0@lo:501: 00000100:00100000:1.0:1788874972.740813:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021056:0@lo:503: 00000100:00100000:1.0:1788874972.740858:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.740877:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.740892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021056 00000100:00100000:1.0:1788874972.740896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021056 00000100:00100000:1.0:1788874972.740935:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788874972.740942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021056:12345-0@lo:503: 00000100:00100000:1.0:1788874972.741301:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021056:12345-0@lo:503: Request processed in 358us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.741309:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788874972.741355:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021056:0@lo:503: 00000040:00080000:1.0:1788874972.741847:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788874972.742212:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021184:0@lo:502: 00000100:00100000:1.0:1788874972.742275:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.742303:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.742328:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021184 00000100:00100000:1.0:1788874972.742334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021184 00000100:00100000:1.0:1788874972.742363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788874972.742371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021184:12345-0@lo:502: 00000100:00100000:3.0:1788874972.742879:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241020928 00000100:00100000:3.0:1788874972.742886:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241020928 00000100:00100000:3.0:1788874972.742954:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788874972.742964:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+14:3304:x1875771241020928:12345-0@lo:103: 00010000:00010000:3.0:1788874972.742981:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874972.743010:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030400/0x60858e6020d820ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d820f8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.743046:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874972.743108:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+13:3304:x1875771241020928:12345-0@lo:103: Request processed in 145us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.743126:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788874972.743473:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241021184:12345-0@lo:502: Request processed in 1099us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.743482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788874972.743553:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241020928:0@lo:103: 00000100:00100000:3.0:1788874972.743744:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021184:0@lo:502: 00000040:00080000:3.0:1788874972.744447:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788874972.744526:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788874972.744563:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788874972.744607:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788874972.744643:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788874972.744676:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788874972.744838:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021312:0@lo:502: 00000100:00100000:3.0:1788874972.744996:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.745062:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.745226:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021312 00000100:00100000:1.0:1788874972.745239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021312 00000100:00100000:1.0:1788874972.745337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788874972.745348:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241021312:12345-0@lo:502: 00000100:00100000:1.0:1788874972.745604:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241021312:12345-0@lo:502: Request processed in 258us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.745612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788874972.745749:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021312:0@lo:502: 00000040:00080000:2.0:1788874972.745936:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788874972.745952:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788874972.747346:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788874972.747360:0:7642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788874972.747369:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788874972.747372:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788874972.747378:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788874972.747417:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e5a35d03380) 00000020:00000080:1.0:1788874972.747446:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788874972.747453:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788874972.747532:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5904e88000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788874972.747542:0:7642:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788874972.747551:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x60858e6020d8211b 00010000:00010000:1.0:1788874972.753402:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788874972.754443:0:7642:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788874972.759380:0:7642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788874972.759985:0:7642:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788874972.764726:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788874972.765373:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788874972.768031:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788874972.768045:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874972.768053:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874972.768056:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788874972.768144:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788874972.768154:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874972.768156:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788874972.768160:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788874972.768162:0:7642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788874972.768225:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874972.768229:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874972.768230:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788874972.768234:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788874972.769168:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788874972.769202:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788874972.769264:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.769277:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874972.769303:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5904e88000 from 1 10000000:01000000:2.0:1788874972.769306:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788874972.769353:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.769360:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.769373:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.769404:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021440:0@lo:101: 00000100:00100000:2.0:1788874972.769498:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.769576:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.772144:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021440 00000100:00100000:1.0:1788874972.772161:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021440 00000100:00100000:1.0:1788874972.772265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788874972.772278:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:7634:x1875771241021440:12345-0@lo:101: 00010000:00010000:1.0:1788874972.772301:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874972.772333:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82122 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.772387:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82122 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.772399:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82122 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874972.772410:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26800, rc 0) 00000100:00100000:1.0:1788874972.772510:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021440:12345-0@lo:101: Request processed in 235us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.772517:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788874972.772600:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021440:0@lo:101: 00010000:00010000:3.0:1788874972.772630:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.772640:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874972.772758:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021568:0@lo:501: 00000100:00100000:3.0:1788874972.772820:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.777400:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.781509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021568 00000100:00100000:2.0:1788874972.781527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021568 00000100:00100000:2.0:1788874972.781584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788874972.781594:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021568:12345-0@lo:501: 00000100:00100000:2.0:1788874972.781940:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021568:12345-0@lo:501: Request processed in 347us (9119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.781948:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788874972.782586:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021568:0@lo:501: 00000100:00100000:3.0:1788874972.782652:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021696:0@lo:503: 00000100:00100000:3.0:1788874972.782704:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.782744:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.782834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021696 00000100:00100000:2.0:1788874972.782840:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021696 00000100:00100000:2.0:1788874972.782915:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788874972.782924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021696:12345-0@lo:503: 00000100:00100000:2.0:1788874972.783434:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021696:12345-0@lo:503: Request processed in 510us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.783450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788874972.783631:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021696:0@lo:503: 00000040:00080000:3.0:1788874972.784054:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788874972.784199:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021824:0@lo:502: 00000100:00100000:3.0:1788874972.784244:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.784321:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.784356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021824 00000100:00100000:1.0:1788874972.784362:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021824 00000100:00100000:1.0:1788874972.784438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788874972.784448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021824:12345-0@lo:502: 00000100:00100000:1.0:1788874972.784656:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021824:12345-0@lo:502: Request processed in 210us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.784663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788874972.784730:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021824:0@lo:502: 00000040:00080000:3.0:1788874972.785020:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788874972.785096:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788874972.785122:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021952:0@lo:502: 00000100:00100000:3.0:1788874972.785156:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.785342:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.785455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241021952 00000100:00100000:2.0:1788874972.785461:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241021952 00000100:00100000:2.0:1788874972.785488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788874972.785495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021952:12345-0@lo:502: 00000100:00100000:2.0:1788874972.785652:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241021952:12345-0@lo:502: Request processed in 156us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.785659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788874972.785743:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241021952:0@lo:502: 00000040:00080000:3.0:1788874972.785881:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788874972.785892:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788874972.787292:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788874972.787310:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874972.787312:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788874972.787332:0:7646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5904e88000 00000020:00000080:3.0:1788874972.787335:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788874972.787361:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874972.787364:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874972.787365:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788874972.787368:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788874972.787544:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788874972.787573:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788874972.787595:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.787607:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874972.787659:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788874972.787662:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5904e88000 10000000:01000000:2.0:1788874972.787666:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5904e88000 10000000:01000000:2.0:1788874972.787670:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788874972.787676:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5904e88000 from 1 10000000:01000000:2.0:1788874972.787680:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788874972.787717:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.787726:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.787736:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.787767:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022080:0@lo:101: 00000100:00100000:2.0:1788874972.787854:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.787896:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022080 00000100:00100000:2.0:1788874972.787904:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022080 00000100:00100000:2.0:1788874972.787939:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788874972.787947:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241022080:12345-0@lo:101: 00010000:00010000:2.0:1788874972.787959:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874972.787973:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82130 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.788000:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82130 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.788011:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82130 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.788020:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027eac00, rc 0) 00000100:00100000:2.0:1788874972.788195:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022080:12345-0@lo:101: Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.788205:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788874972.788250:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.788269:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022080:0@lo:101: 00010000:00010000:2.0:1788874972.788282:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874972.788290:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874972.788389:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022208:0@lo:501: 00000100:00100000:2.0:1788874972.788415:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.788474:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788874972.788862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022208 00000100:00100000:1.0:1788874972.788868:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022208 00000100:00100000:3.0:1788874972.788984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788874972.788999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022208:12345-0@lo:501: 00000100:00100000:3.0:1788874972.789256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022208:12345-0@lo:501: Request processed in 263us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.789262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788874972.789361:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022208:0@lo:501: 00000100:00100000:2.0:1788874972.789393:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022336:0@lo:503: 00000100:00100000:2.0:1788874972.789429:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.789458:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874972.789498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022336 00000100:00100000:3.0:1788874972.789502:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022336 00000100:00100000:3.0:1788874972.789521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788874972.789527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022336:12345-0@lo:503: 00000100:00100000:3.0:1788874972.789699:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022336:12345-0@lo:503: Request processed in 171us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.789706:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788874972.789796:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022336:0@lo:503: 00000040:00080000:2.0:1788874972.790104:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788874972.790166:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022464:0@lo:502: 00000100:00100000:2.0:1788874972.790201:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874972.790222:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874972.794390:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022464 00000100:00100000:3.0:1788874972.794406:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022464 00000100:00100000:3.0:1788874972.794470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788874972.794480:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022464:12345-0@lo:502: 00000100:00100000:3.0:1788874972.795016:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022464:12345-0@lo:502: Request processed in 535us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.795034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788874972.795517:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022464:0@lo:502: 00000040:00080000:3.0:1788874972.798618:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788874972.798728:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788874972.798895:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788874972.798964:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788874972.799003:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788874972.799064:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788874972.799103:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788874972.799137:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788874972.799184:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788874972.799220:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788874972.799275:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788874972.799323:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788874972.799357:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788874972.799388:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788874972.799590:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788874972.799634:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788874972.799668:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788874972.799712:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788874972.799751:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788874972.800113:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788874972.800184:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788874972.800222:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788874972.800258:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788874972.800305:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788874972.800343:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788874972.800377:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788874972.800584:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788874972.800625:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788874972.800660:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788874972.800709:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788874972.800746:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788874972.800883:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788874972.800922:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788874972.800986:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788874972.801039:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788874972.801088:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788874972.801134:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788874972.801188:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022592:0@lo:502: 00000100:00100000:3.0:1788874972.801285:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.801377:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788874972.806106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022592 00000100:00100000:0.0:1788874972.806126:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022592 00000100:00100000:0.0:1788874972.806243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788874972.806256:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022592:12345-0@lo:502: 00000100:00100000:0.0:1788874972.806647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022592:12345-0@lo:502: Request processed in 393us (5361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.806661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788874972.815104:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022592:0@lo:502: 00000040:00080000:3.0:1788874972.815275:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788874972.815294:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788874972.816857:0:7647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788874972.816875:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e5a049319c0) 00000020:00000080:0.0:1788874972.816901:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788874972.816971:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5904e88000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788874972.816975:0:7647:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5904e88000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788874972.816978:0:7647:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5904e88000 3 00010000:00080000:0.0:1788874972.817010:0:7647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a3616c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1788874972.819078:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788874972.819337:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788874972.819376:0:7647:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788874972.819389:0:7647:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x60858e6020d82145 00000100:00080000:0.0:1788874972.819403:0:7647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788874972.819409:0:7647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e5a3616c000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788874972.825396:0:7647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a048d6d80 x1875771241022720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788874972.827131:0:7647:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788874972.827359:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241022720:0@lo:38: 00000100:00100000:1.0:1788874972.828797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.828877:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022720 00000100:00100000:1.0:1788874972.828885:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022720 00000100:00100000:1.0:1788874972.828921:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788874972.828930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875771241022720:12345-0@lo:38: 00010000:00080000:1.0:1788874972.828957:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788874972.829003:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x60858e6020d8214c 00000004:00100000:1.0:1788874972.829018:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788874972.829061:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9e5a3f772800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788874972.829125:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875771241022720:12345-0@lo:38: Request processed in 194us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874972.829133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788874972.829176:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a048d6d80 x1875771241022720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788874982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874972.829188:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788874972.829196:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788874972.829203:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788874972.829208:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788874972.829210:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a3616c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788874972.829217:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241022720:0@lo:38: 00000100:00100000:1.0:1788874972.832273:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875771241022848:0@lo:901: 00000040:00080000:0.0:1788874972.832318:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788874972.832359:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874972.832406:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258600 going to sleep for 11 seconds 00000020:01000000:3.0:1788874972.832585:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788874972.832616:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788874972.832633:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.832644:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788874972.832709:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788874972.832711:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788874972.832712:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788874972.832714:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788874972.832715:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788874972.832716:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788874972.832718:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788874972.832720:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788874972.832721:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788874972.832723:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788874972.832724:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788874972.832728:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788874972.832730:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788874972.832732:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788874972.832733:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788874972.832734:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788874972.832735:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788874972.832736:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788874972.832737:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788874972.832744:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788874972.832744:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788874972.832745:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788874972.832746:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788874972.832763:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788874972.832792:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022976:0@lo:253: 00000100:00100000:3.0:1788874972.832833:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.832861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022976 00000100:00100000:3.0:1788874972.832869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022976 00000100:00100000:3.0:1788874972.832911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788874972.832920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7634:x1875771241022976:12345-0@lo:253: 20000000:01000000:3.0:1788874972.832949:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788874972.832962:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788874972.833638:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a09959e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874972.833910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241022848 00000100:00100000:2.0:1788874972.833918:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241022848 00000100:00100000:2.0:1788874972.834002:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788874972.834014:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875771241022848:12345-0@lo:901: 00000100:00080000:2.0:1788874972.834074:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788874972.839851:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875771241022848:12345-0@lo:901: Request processed in 5828us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874972.839875:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788874972.843510:0:7649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a362b1f80 x1875771241022848/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788874988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874972.843530:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875771241022848:0@lo:901: 20000000:01000000:0.0:1788874972.859238:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788874972.859288:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788874972.865015:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788874972.865034:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788874972.865057:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.865078:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8209d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.865086:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.865132:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.865147:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 14 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874972.865162:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241023104:0@lo:104: 00000100:00100000:3.0:1788874972.865241:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874972.865281:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788874972.865302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023104 00000100:00100000:3.0:1788874972.865309:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023104 00000100:00100000:3.0:1788874972.865355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874972.865364:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241023104:12345-0@lo:104: 00010000:00010000:3.0:1788874972.865377:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874972.865432:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788874972.865438:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:5857:x1875771241023104:12345-0@lo:104: Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874972.865445:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874972.865493:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875771241023104:0@lo:104: 00010000:00010000:3.0:1788874972.865510:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865673:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788874972.865681:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865697:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb600 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788874972.865701:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865718:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788874972.865724:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874972.865730:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788874972.865760:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865765:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788874972.865796:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865803:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d8209d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d820a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865819:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874972.865821:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874972.865823:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874972.865839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241023232:0@lo:103: 00000100:00100000:0.0:1788874972.865873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874972.865907:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023232 00000100:00100000:0.0:1788874972.865911:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023232 00010000:00010000:0.0:1788874972.865928:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 15 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874972.865956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874972.865963:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+15:3305:x1875771241023232:12345-0@lo:103: 00010000:00010000:0.0:1788874972.865974:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874972.865979:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 15 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.865990:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 15 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866003:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d820a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8209d expref: 15 pid: 5835 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866016:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866032:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788874972.866046:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011692244s 00010000:00010000:0.0:1788874972.866050:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866058:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866065:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866072:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866084:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788874972.866088:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866095:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866108:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866119:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874972.866147:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+14:3305:x1875771241023232:12345-0@lo:103: Request processed in 185us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.866154:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874972.866204:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241023232:0@lo:103: 00010000:00010000:0.0:1788874972.866224:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866230:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874972.866236:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d82153 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874972.868803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:7634:x1875771241022976:12345-0@lo:253: Request processed in 35853us (35939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874972.868820:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788874972.868917:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:372e367e-0deb-4060-9f2e-265b56425d5a:7634:1875771241022976:0@lo:253: 10000000:01000000:3.0:1788874972.868933:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788874972.868936:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788874972.868938:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788874972.868939:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788874972.868940:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788874972.868941:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788874972.868943:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788874972.868944:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788874972.868946:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788874972.868947:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788874972.868949:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788874972.868950:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788874972.868965:0:7634:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788874972.878334:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874972.879093:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874972.879313:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874972.879542:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788874972.879820:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788874972.880098:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788874972.882005:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788874972.945825:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788874973.098569:0:7634:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788874973.098590:0:7634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788874973.098631:0:7634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788874973.098691:0:7634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788874973.098791:0:7634:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788874973.098812:0:7634:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788874973.973337:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874974.992923:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788874976.014011:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874977.051517:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874977.625339:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788874977.625365:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241023360:0@lo:13: 00000100:00100000:1.0:1788874977.625438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874977.625510:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023360 00000100:00100000:1.0:1788874977.625518:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023360 00000100:00100000:1.0:1788874977.625574:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788874977.625583:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241023360:12345-0@lo:13: 00000100:00080000:2.0:1788874977.625858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788874977.625957:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874977.626034:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241023360:12345-0@lo:13: Request processed in 452us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874977.626042:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788874977.626176:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b1180 x1875771241023360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874977.626196:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241023360:0@lo:13: 00010000:00010000:2.0:1788874978.068570:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874978.127568:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241023616:0@lo:400: 00000100:00100000:3.0:1788874978.127638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.127696:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788874978.127703:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241023488:0@lo:400: 00000100:00100000:3.0:1788874978.127732:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.127764:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241023744:0@lo:400: 00000100:00100000:3.0:1788874978.127809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.127828:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788874978.127833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241023872:0@lo:400: 00000100:00100000:3.0:1788874978.127859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.127894:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023616 00000100:00100000:3.0:1788874978.127902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023616 00000100:00100000:3.0:1788874978.127939:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023744 00000100:00100000:3.0:1788874978.127942:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023744 00000100:00100000:3.0:1788874978.127964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023872 00000100:00100000:3.0:1788874978.127967:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023872 00000100:00100000:3.0:1788874978.127996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874978.128004:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241023616:12345-0@lo:400: 00000100:00100000:3.0:1788874978.128058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241023616:12345-0@lo:400: Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.128065:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788874978.128083:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874978.128090:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241023744:12345-0@lo:400: 00000100:00100000:3.0:1788874978.128128:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241023744:12345-0@lo:400: Request processed in 40us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.128146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874978.128157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874978.128163:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241023872:12345-0@lo:400: 00000100:00100000:3.0:1788874978.128188:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241023872:12345-0@lo:400: Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.128193:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874978.128210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241023488 00000100:00100000:3.0:1788874978.128213:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241023488 00000100:00100000:3.0:1788874978.128236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788874978.128242:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:3304:x1875771241023488:12345-0@lo:400: 00000100:00100000:3.0:1788874978.128268:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:3304:x1875771241023488:12345-0@lo:400: Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.128272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788874978.128303:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788874978.128330:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483e680 x1875771241023872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.128344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241023872:0@lo:400: 00010000:00080000:3.0:1788874978.128353:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483ea00 x1875771241023744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.128360:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241023744:0@lo:400: 00000100:00100000:3.0:1788874978.128385:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241023488:0@lo:400: 00010000:00080000:3.0:1788874978.128394:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483e300 x1875771241023616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.128401:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241023616:0@lo:400: 10000000:01000000:1.0:1788874978.139123:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788874978.139132:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a07881000 from 30 10000000:01000000:1.0:1788874978.139138:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788874978.139188:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.139202:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.139215:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874978.139242:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024000:0@lo:101: 00000100:00100000:1.0:1788874978.139319:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.139369:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.139557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024000 00000100:00100000:0.0:1788874978.139566:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024000 00000100:00100000:0.0:1788874978.139616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788874978.139626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241024000:12345-0@lo:101: 00010000:00010000:0.0:1788874978.139639:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874978.139654:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8215a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.139689:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8215a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.139700:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8215a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.139709:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031a00, rc 0) 00000100:00100000:0.0:1788874978.139747:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024000:12345-0@lo:101: Request processed in 123us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.139754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788874978.147903:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024000:0@lo:101: 00010000:00010000:1.0:1788874978.147933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.147948:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874978.148033:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024128:0@lo:501: 00000100:00100000:1.0:1788874978.148109:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.148136:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:1.0:1788874978.148157:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024128 00000100:00100000:1.0:1788874978.148170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024128 00000100:00100000:1.0:1788874978.148211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788874978.148221:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024128:12345-0@lo:501: 00000100:00100000:1.0:1788874978.148544:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024128:12345-0@lo:501: Request processed in 324us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874978.148552:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788874978.148589:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024128:0@lo:501: 00000100:00100000:1.0:1788874978.148615:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024256:0@lo:503: 00000100:00100000:1.0:1788874978.148817:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.148836:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876840 going to sleep for 11 seconds 00000100:00100000:1.0:1788874978.148848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024256 00000100:00100000:1.0:1788874978.148852:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024256 00000100:00100000:1.0:1788874978.148875:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788874978.148882:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024256:12345-0@lo:503: 00000100:00100000:1.0:1788874978.149175:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024256:12345-0@lo:503: Request processed in 291us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874978.149183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788874978.149219:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024256:0@lo:503: 00000100:00100000:1.0:1788874978.149376:0:7916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7916:1875771241024384:0@lo:502: 00000100:00100000:1.0:1788874978.149410:0:7916:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.149430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024384 00000100:00100000:1.0:1788874978.149433:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024384 00000100:00100000:1.0:1788874978.149454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788874978.149461:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7916:x1875771241024384:12345-0@lo:502: 00000100:00100000:1.0:1788874978.151191:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:7916:x1875771241024384:12345-0@lo:502: Request processed in 193us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874978.151217:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788874978.151275:0:7916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0456f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788874978.151298:0:7916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7916:1875771241024384:0@lo:502: 00000100:00100000:1.0:1788874978.151360:0:7916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7916:1875771241024512:0@lo:502: 00000100:00100000:1.0:1788874978.151415:0:7916:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.151539:0:7916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.160248:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024512 00000100:00100000:0.0:1788874978.160264:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024512 00000100:00100000:0.0:1788874978.160324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788874978.160335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:7916:x1875771241024512:12345-0@lo:502: 00000100:00100000:0.0:1788874978.160621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:7916:x1875771241024512:12345-0@lo:502: Request processed in 287us (9203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.160629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788874978.160705:0:7916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7916:1875771241024512:0@lo:502: 00000040:00080000:0.0:1788874978.160737:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788874978.160842:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788874978.160857:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788874978.160867:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.160879:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788874978.160888:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788874978.160891:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788874978.160894:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788874978.160926:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.160935:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.160944:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874978.160963:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024640:0@lo:101: 00000100:00100000:0.0:1788874978.161018:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.161049:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.161061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024640 00000100:00100000:0.0:1788874978.161064:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024640 00000100:00100000:0.0:1788874978.161087:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788874978.161094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241024640:12345-0@lo:101: 00010000:00010000:0.0:1788874978.161102:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874978.161114:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82168 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.161146:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82168 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.161157:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82168 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.161166:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030400, rc 0) 00000100:00100000:0.0:1788874978.161194:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241024640:12345-0@lo:101: Request processed in 100us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.161199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788874978.161227:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024640:0@lo:101: 00010000:00010000:0.0:1788874978.161239:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874978.161248:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874978.161287:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024768:0@lo:501: 00000100:00100000:0.0:1788874978.161310:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.161322:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.161332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024768 00000100:00100000:0.0:1788874978.161335:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024768 00000100:00100000:0.0:1788874978.161353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788874978.161359:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241024768:12345-0@lo:501: 00000100:00100000:0.0:1788874978.161566:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241024768:12345-0@lo:501: Request processed in 206us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.161572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788874978.161608:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024768:0@lo:501: 00000100:00100000:0.0:1788874978.161631:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024896:0@lo:503: 00000100:00100000:0.0:1788874978.161663:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.161675:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.161685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241024896 00000100:00100000:0.0:1788874978.161688:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241024896 00000100:00100000:0.0:1788874978.161707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788874978.161713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241024896:12345-0@lo:503: 00000100:00100000:0.0:1788874978.162016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241024896:12345-0@lo:503: Request processed in 302us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.162022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788874978.162060:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241024896:0@lo:503: 00000100:00100000:2.0:1788874978.164388:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7920:1875771241025024:0@lo:502: 00000100:00100000:2.0:1788874978.164471:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.164504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025024 00000100:00100000:2.0:1788874978.164511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025024 00000100:00100000:2.0:1788874978.164553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788874978.164562:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:7920:x1875771241025024:12345-0@lo:502: 00000100:00100000:2.0:1788874978.164860:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:7920:x1875771241025024:12345-0@lo:502: Request processed in 297us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.164868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788874978.164907:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.164928:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7920:1875771241025024:0@lo:502: 00000020:01000000:2.0:1788874978.164958:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874978.164968:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874978.164970:0:7920:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788874978.164989:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788874978.164990:0:7920:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788874978.165006:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7920:1875771241025152:0@lo:502: 00000100:00100000:2.0:1788874978.165042:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.165061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025152 00000100:00100000:2.0:1788874978.165065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025152 00000100:00100000:2.0:1788874978.165087:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788874978.165093:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:7920:x1875771241025152:12345-0@lo:502: 00000100:00100000:2.0:1788874978.165198:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:7920:x1875771241025152:12345-0@lo:502: Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.165205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788874978.165233:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.165243:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7920:1875771241025152:0@lo:502: 00000020:01000000:2.0:1788874978.165260:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874978.165264:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874978.165265:0:7920:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788874978.165268:0:7920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788874978.165317:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788874978.165333:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788874978.165343:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165354:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874978.165365:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788874978.165368:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a06641800 from 30 10000000:01000000:2.0:1788874978.165371:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788874978.165395:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165404:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165422:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.165434:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025280:0@lo:101: 00000100:00100000:2.0:1788874978.165459:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.165471:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.165482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025280 00000100:00100000:2.0:1788874978.165485:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025280 00000100:00100000:2.0:1788874978.165505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788874978.165511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241025280:12345-0@lo:101: 00010000:00010000:2.0:1788874978.165519:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874978.165530:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82176 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165550:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82176 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165561:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82176 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165570:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027ea000, rc 0) 00000100:00100000:2.0:1788874978.165599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025280:12345-0@lo:101: Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.165605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788874978.165634:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025280:0@lo:101: 00010000:00010000:2.0:1788874978.165646:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.165666:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.165704:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025408:0@lo:501: 00000100:00100000:2.0:1788874978.165726:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.165738:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.165748:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025408 00000100:00100000:2.0:1788874978.165751:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025408 00000100:00100000:2.0:1788874978.165795:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788874978.165803:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025408:12345-0@lo:501: 00000100:00100000:2.0:1788874978.166041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025408:12345-0@lo:501: Request processed in 238us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.166048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788874978.166080:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025408:0@lo:501: 00000100:00100000:2.0:1788874978.166106:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025536:0@lo:503: 00000100:00100000:2.0:1788874978.166140:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.166153:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.166164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025536 00000100:00100000:2.0:1788874978.166167:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025536 00000100:00100000:2.0:1788874978.166184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788874978.166190:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025536:12345-0@lo:503: 00000100:00100000:2.0:1788874978.166317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025536:12345-0@lo:503: Request processed in 126us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.166323:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788874978.166359:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025536:0@lo:503: 00000100:00100000:2.0:1788874978.166625:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7923:1875771241025664:0@lo:502: 00000100:00100000:2.0:1788874978.166657:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.166675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025664 00000100:00100000:2.0:1788874978.166678:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025664 00000100:00100000:2.0:1788874978.166700:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788874978.166706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:7923:x1875771241025664:12345-0@lo:502: 00000100:00100000:2.0:1788874978.166868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:7923:x1875771241025664:12345-0@lo:502: Request processed in 161us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.166875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788874978.166904:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03242540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.166917:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7923:1875771241025664:0@lo:502: 00000100:00100000:2.0:1788874978.166952:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7923:1875771241025792:0@lo:502: 00000100:00100000:2.0:1788874978.174268:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.174463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025792 00000100:00100000:2.0:1788874978.174473:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025792 00000100:00100000:2.0:1788874978.174521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788874978.174531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:7923:x1875771241025792:12345-0@lo:502: 00000100:00100000:2.0:1788874978.175411:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:7923:x1875771241025792:12345-0@lo:502: Request processed in 877us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.175421:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788874978.175797:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03242540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.175827:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7923:1875771241025792:0@lo:502: 00000040:00080000:2.0:1788874978.175868:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788874978.175935:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788874978.175952:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788874978.175970:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.175992:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874978.176002:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788874978.176005:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5a06641800 from 5 10000000:01000000:2.0:1788874978.176008:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788874978.176040:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176048:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176056:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.176074:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025920:0@lo:101: 00000100:00100000:2.0:1788874978.176110:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.176129:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03242540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.176143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241025920 00000100:00100000:2.0:1788874978.176148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241025920 00000100:00100000:2.0:1788874978.176177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788874978.176184:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241025920:12345-0@lo:101: 00010000:00010000:2.0:1788874978.176196:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874978.176207:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027eaa00/0x60858e6020d8218b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82184 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176229:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027eaa00/0x60858e6020d8218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82184 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176245:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027eaa00/0x60858e6020d8218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82184 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176253:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027eaa00, rc 0) 00000100:00100000:2.0:1788874978.176282:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241025920:12345-0@lo:101: Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.176288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788874978.176320:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241025920:0@lo:101: 00010000:00010000:2.0:1788874978.176332:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.176341:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.176381:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026048:0@lo:256: 00000100:00100000:2.0:1788874978.176410:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.176422:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03242540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.176433:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026048 00000100:00100000:2.0:1788874978.176437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026048 00000100:00100000:2.0:1788874978.176457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788874978.176463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241026048:12345-0@lo:256: 20000000:01000000:2.0:1788874978.176475:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788874978.176491:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788874978.176494:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788874978.176564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241026048:12345-0@lo:256: Request processed in 101us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.176571:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788874978.176607:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026048:0@lo:256: 10000000:01000000:2.0:1788874978.176642:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788874978.176648:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.177838:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874978.177852:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788874978.177854:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788874978.177857:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788874978.177886:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.177894:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.177904:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.177921:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026176:0@lo:101: 00000100:00100000:2.0:1788874978.177969:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.178010:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03242540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.178031:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026176 00000100:00100000:2.0:1788874978.178036:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026176 00000100:00100000:2.0:1788874978.178069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788874978.178076:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241026176:12345-0@lo:101: 00010000:00010000:2.0:1788874978.178087:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874978.178099:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82192 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.178125:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82192 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.178135:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82192 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.178143:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027eb400, rc 0) 00000100:00100000:2.0:1788874978.178175:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241026176:12345-0@lo:101: Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.178181:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788874978.178222:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026176:0@lo:101: 00010000:00010000:2.0:1788874978.178235:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874978.178243:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874978.178290:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026304:0@lo:501: 00000100:00100000:2.0:1788874978.178317:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.178331:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.178342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026304 00000100:00100000:2.0:1788874978.178345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026304 00000100:00100000:2.0:1788874978.178363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788874978.178368:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241026304:12345-0@lo:501: 00000100:00100000:2.0:1788874978.178618:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241026304:12345-0@lo:501: Request processed in 248us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.178624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788874978.179800:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026304:0@lo:501: 00000100:00100000:2.0:1788874978.179856:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026432:0@lo:503: 00000100:00100000:2.0:1788874978.179912:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874978.179947:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082240 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.179968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026432 00000100:00100000:2.0:1788874978.185276:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026432 00000100:00100000:2.0:1788874978.185342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788874978.185353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241026432:12345-0@lo:503: 00000100:00100000:2.0:1788874978.185763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241026432:12345-0@lo:503: Request processed in 410us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.185786:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788874978.186095:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241026432:0@lo:503: 00000100:00100000:3.0:1788874978.191536:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7924:1875771241026560:0@lo:502: 00000100:00100000:3.0:1788874978.191638:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.191821:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0333e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.193003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026560 00000100:00100000:2.0:1788874978.193013:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026560 00000100:00100000:2.0:1788874978.193111:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788874978.193127:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:7924:x1875771241026560:12345-0@lo:502: 00000100:00100000:2.0:1788874978.193534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:7924:x1875771241026560:12345-0@lo:502: Request processed in 409us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.193542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788874978.194855:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7924:1875771241026560:0@lo:502: 00000020:01000000:0.0:1788874978.197172:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788874978.197184:0:7924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788874978.197192:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874978.197194:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788874978.197199:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788874978.197204:0:7924:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:0.0:1788874978.197230:0:7924:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788874978.197232:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788874978.197247:0:7924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e5a04933380) 00000020:00000080:0.0:1788874978.197267:0:7924:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788874978.197271:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788874978.197341:0:7924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788874978.197347:0:7924:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788874978.197352:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d821a7 00010000:00080000:0.0:1788874978.197380:0:7924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a36169800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1788874978.197598:0:7924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788874978.197956:0:7924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788874978.197983:0:7924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788874978.198442:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788874978.198630:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788874978.198674:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788874978.198722:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788874978.202373:0:7926:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788874978.202383:0:7926:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788874978.203538:0:7924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788874978.203553:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788874978.203587:0:7924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788874978.203610:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d821ae 00000100:00080000:3.0:1788874978.203620:0:7924:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788874978.203627:0:7924:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a36169800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1788874978.203736:0:7924:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a0483ed80 x1875771241026688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788874978.203814:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241026688:0@lo:8: 00000100:00100000:1.0:1788874978.203910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788874978.204009:0:7924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788874978.204120:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241026816:0@lo:400: 00000100:00100000:3.0:1788874978.204156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.204180:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874978.204186:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241026944:0@lo:400: 00000100:00100000:3.0:1788874978.204209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.204238:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241027072:0@lo:400: 00000100:00100000:3.0:1788874978.204280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.204300:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788874978.204306:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241027200:0@lo:400: 00000100:00100000:3.0:1788874978.204330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.204362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026816 00000100:00100000:3.0:1788874978.204371:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026816 00000100:00100000:3.0:1788874978.204413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026944 00000100:00100000:3.0:1788874978.204416:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026944 00000100:00100000:3.0:1788874978.204428:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027200 00000100:00100000:3.0:1788874978.204430:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027200 00000100:00100000:3.0:1788874978.204446:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874978.204454:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241026816:12345-0@lo:400: 00000100:00100000:3.0:1788874978.204511:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241026816:12345-0@lo:400: Request processed in 57us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.204518:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874978.204536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874978.204542:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241026944:12345-0@lo:400: 00000100:00100000:3.0:1788874978.204567:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241026944:12345-0@lo:400: Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.204573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874978.204584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874978.204590:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241027200:12345-0@lo:400: 00000100:00100000:3.0:1788874978.204620:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241027200:12345-0@lo:400: Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.204626:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874978.204649:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241026688 00000100:00100000:3.0:1788874978.204652:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241026688 00000100:00100000:0.0:1788874978.204785:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027072 00000100:00100000:0.0:1788874978.204790:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027072 00000100:00100000:0.0:1788874978.204820:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788874978.204828:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241027072:12345-0@lo:400: 00000100:00100000:0.0:1788874978.204863:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241027072:12345-0@lo:400: Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.204869:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788874978.205756:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788874978.205764:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241026688:12345-0@lo:8: 00010000:00080000:3.0:1788874978.205831:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1788874978.205868:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d821b5 00002000:00100000:3.0:1788874978.205884:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e5904e8b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788874978.205888:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788874978.205899:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788874978.206045:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788874978.206215:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788874978.206245:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9e5904e8b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874978.207890:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875771241026688:12345-0@lo:8: Request processed in 2118us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.207901:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788874978.208002:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483f800 x1875771241027200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.208017:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241027200:0@lo:400: 00010000:00080000:3.0:1788874978.208031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483ce00 x1875771241027072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.208040:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241027072:0@lo:400: 00010000:00080000:3.0:1788874978.208086:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483e680 x1875771241026944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.208097:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241026944:0@lo:400: 00010000:00080000:3.0:1788874978.208109:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483ea00 x1875771241026816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.208116:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241026816:0@lo:400: 00000020:01000000:3.0:1788874978.208208:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874978.208216:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874978.208219:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788874978.208222:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788874978.208227:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874978.208228:0:7924:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788874978.208232:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788874978.208249:0:7924:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788874978.208290:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7924:1875771241027328:0@lo:502: 00000100:00100000:3.0:1788874978.208363:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.208399:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0333ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.208557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027328 00000100:00100000:2.0:1788874978.208564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027328 00000100:00100000:2.0:1788874978.208611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788874978.208620:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:7924:x1875771241027328:12345-0@lo:502: 00000100:00100000:2.0:1788874978.208899:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:7924:x1875771241027328:12345-0@lo:502: Request processed in 280us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.208906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788874978.210819:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:7924:1875771241027328:0@lo:502: 00000020:01000000:3.0:1788874978.210861:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788874978.210869:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788874978.210872:0:7924:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788874978.210876:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788874978.211902:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788874978.211928:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788874978.211940:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.211953:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874978.211965:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788874978.211968:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e5a0472b380 from 1 10000000:01000000:1.0:1788874978.211983:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788874978.212025:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.212033:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874978.212042:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874978.212072:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241027456:0@lo:101: 00000100:00100000:1.0:1788874978.212144:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.212194:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788874978.212760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027456 00000100:00100000:3.0:1788874978.212799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027456 00000100:00100000:3.0:1788874978.212855:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788874978.212866:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241027456:12345-0@lo:101: 00010000:00010000:3.0:1788874978.212881:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874978.212896:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d821bc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874978.212924:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d821bc expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874978.212937:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d821bc expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874978.212948:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15e00, rc 0) 00000100:00100000:3.0:1788874978.213013:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241027456:12345-0@lo:101: Request processed in 148us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.213019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788874978.213071:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241027456:0@lo:101: 00010000:00010000:3.0:1788874978.213088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874978.213106:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874978.213167:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241027584:0@lo:501: 00000100:00100000:3.0:1788874978.213195:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.213221:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0333ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788874978.213235:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027584 00000100:00100000:3.0:1788874978.213238:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027584 00000100:00100000:3.0:1788874978.213260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788874978.213267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241027584:12345-0@lo:501: 00000100:00100000:3.0:1788874978.213516:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241027584:12345-0@lo:501: Request processed in 249us (319us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788874978.213523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788874978.213552:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241027584:0@lo:501: 10000000:01000000:3.0:1788874978.213580:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788874978.213586:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874978.213594:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788874978.215920:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a0483ed80 x1875771241026688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788874988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874978.215937:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788874978.215948:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788874978.215958:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788874978.215964:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788874978.215967:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a36169800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788874978.216006:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788874978.216013:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241026688:0@lo:8: 00000004:00080000:3.0:1788874978.218442:0:7926:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788874978.218603:0:7926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193083829646ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788874978.294991:0:7927:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788874978.295025:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241027840:0@lo:7: 00000100:00100000:1.0:1788874978.295091:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874978.295144:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0456f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.296464:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027840 00000100:00100000:0.0:1788874978.296475:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027840 00000100:00100000:0.0:1788874978.296538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788874978.296547:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7927:x1875771241027840:12345-0@lo:7: 00000100:00080000:1.0:1788874978.300195:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874978.302068:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241027712:0@lo:13: 00000100:00100000:3.0:1788874978.302168:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874978.302247:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027712 00000100:00100000:3.0:1788874978.302265:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027712 00000100:00100000:3.0:1788874978.302318:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788874978.302329:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241027712:12345-0@lo:13: 00002000:00000024:3.0:1788874978.302372:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788874978.302426:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241027712:12345-0@lo:13: Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.302434:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788874978.302478:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b1180 x1875771241027712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.302498:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241027712:0@lo:13: 00002000:00080000:0.0:1788874978.307676:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788874978.307687:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788874978.307815:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7927:x1875771241027840:12345-0@lo:7: Request processed in 11265us (12719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874978.307834:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788874978.307893:0:7927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b2300 x1875771241027840/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788874994 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874978.307908:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241027840:0@lo:7: 00000004:00080000:0.0:1788874978.307922:0:7927:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788874978.307961:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241027968:0@lo:5: 00000100:00100000:0.0:1788874978.308005:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.308036:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a24420cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.308055:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241027968 00000100:00100000:0.0:1788874978.308061:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241027968 00000100:00100000:0.0:1788874978.308106:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788874978.308114:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7927:x1875771241027968:12345-0@lo:5: 00002000:00080000:0.0:1788874978.308138:0:6901:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788874978.308141:0:6901:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788874978.308338:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7927:x1875771241027968:12345-0@lo:5: Request processed in 225us (332us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788874978.308345:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788874978.308372:0:7927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a048d5500 x1875771241027968/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874994 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874978.308383:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241027968:0@lo:5: 00000004:00080000:0.0:1788874978.308392:0:7927:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788874978.308413:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241028096:0@lo:700: 00000100:00100000:0.0:1788874978.308435:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.308451:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a24420cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.315878:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028096 00000100:00100000:0.0:1788874978.315913:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028096 00000100:00100000:0.0:1788874978.316005:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788874978.316015:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7927:x1875771241028096:12345-0@lo:700: 00000100:00100000:0.0:1788874978.316090:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875771241028224:0@lo:700: 00000100:00100000:0.0:1788874978.316175:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.316221:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a24420000 going to sleep for 11 seconds 00000100:00100000:0.0:1788874978.316242:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028224 00000100:00100000:0.0:1788874978.316246:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028224 00000100:00100000:0.0:1788874978.316274:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788874978.316282:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875771241028224:12345-0@lo:700: 00000004:00080000:0.0:1788874978.363229:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788874978.437765:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788874978.445955:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875771241028224:12345-0@lo:700: Request processed in 129662us (129768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874978.445987:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788874978.449497:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a048d4380 x1875771241028224/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788874994 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874978.449518:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875771241028224:0@lo:700: 40000000:02000000:0.0:1788874978.449535:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788874978.530589:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788874978.530617:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788874978.531189:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7927:x1875771241028096:12345-0@lo:700: Request processed in 215170us (222746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874978.531207:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788874978.531308:0:7927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a048d4000 x1875771241028096/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788874994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.531320:0:7927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788874978.531337:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241028096:0@lo:700: 00000004:02000040:2.0:1788874978.584116:0:7927:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788874978.588488:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241028352:0@lo:5: 00000100:00100000:0.0:1788874978.588557:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874978.588613:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1098f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788874978.588811:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028352 00000100:00100000:2.0:1788874978.588820:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028352 00000100:00100000:2.0:1788874978.588864:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788874978.588874:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7927:x1875771241028352:12345-0@lo:5: 00002000:00080000:2.0:1788874978.600291:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788874978.600315:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788874978.605016:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7927:x1875771241028352:12345-0@lo:5: Request processed in 16135us (16451us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788874978.605029:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788874978.605141:0:7927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a048d4380 x1875771241028352/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788874994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874978.605163:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7927:1875771241028352:0@lo:5: 00000004:00080000:3.0:1788874978.605183:0:7927:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788874979.086148:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788874979.715033:0:7998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788874980.111044:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874981.138326:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874982.158803:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874982.741992:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241028480:0@lo:13: 00000100:00100000:3.0:1788874982.742103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874982.742423:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028480 00000100:00100000:1.0:1788874982.742436:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028480 00000100:00100000:1.0:1788874982.742535:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788874982.742549:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241028480:12345-0@lo:13: 00002000:00000024:1.0:1788874982.742603:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874982.742679:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241028480:12345-0@lo:13: Request processed in 134us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874982.742687:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788874982.742861:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b3b80 x1875771241028480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874982.742887:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241028480:0@lo:13: 00000100:00080000:3.0:1788874982.743012:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788874983.188570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788874983.254459:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241028608:0@lo:400: 00000100:00100000:0.0:1788874983.254556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874983.254648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028608 00000100:00100000:2.0:1788874983.254658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028608 00000100:00100000:2.0:1788874983.254709:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788874983.254717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241028608:12345-0@lo:400: 00000100:00100000:2.0:1788874983.264684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241028608:12345-0@lo:400: Request processed in 9955us (10115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874983.264702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788874983.266559:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241028736:0@lo:400: 00000100:00100000:2.0:1788874983.266633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874983.267084:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241028608:0@lo:400: 00000100:00100000:2.0:1788874983.267280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241028864:0@lo:400: 00000100:00100000:2.0:1788874983.267312:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874983.267406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028736 00000100:00100000:0.0:1788874983.267412:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028736 00000100:00100000:0.0:1788874983.267455:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028864 00000100:00100000:0.0:1788874983.267458:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028864 00000100:00100000:0.0:1788874983.267482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788874983.267491:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241028736:12345-0@lo:400: 00000100:00100000:0.0:1788874983.267560:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241028736:12345-0@lo:400: Request processed in 69us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874983.267567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788874983.267582:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788874983.267588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241028864:12345-0@lo:400: 00000100:00100000:3.0:1788874983.268302:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241028992:0@lo:400: 00000100:00100000:3.0:1788874983.268337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788874983.268373:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788874983.268385:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241028992 00000100:00100000:3.0:1788874983.268390:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241028992 00000100:00100000:3.0:1788874983.268420:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788874983.268426:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241028992:12345-0@lo:400: 00000100:00100000:3.0:1788874983.268462:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241028992:12345-0@lo:400: Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874983.268468:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788874983.268501:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d70380 x1875771241028992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874983.268513:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241028992:0@lo:400: 00000100:00100000:0.0:1788874983.273390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241028864:12345-0@lo:400: Request processed in 5791us (6066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874983.273405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788874983.275124:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241029120:0@lo:400: 00000100:00100000:3.0:1788874983.275219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874983.275278:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788874983.275291:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241029248:0@lo:400: 00000100:00100000:3.0:1788874983.275321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874983.275366:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029248 00000100:00100000:3.0:1788874983.275373:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029248 00000100:00100000:3.0:1788874983.275428:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788874983.275438:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241029248:12345-0@lo:400: 00000100:00100000:3.0:1788874983.275489:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241029248:12345-0@lo:400: Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874983.275496:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788874983.275517:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788874983.275633:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029120 00000100:00100000:0.0:1788874983.275638:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029120 00000100:00100000:0.0:1788874983.275672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788874983.275680:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241029120:12345-0@lo:400: 00000100:00100000:0.0:1788874983.275715:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241029120:12345-0@lo:400: Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874983.275721:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788874983.275757:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788874983.275831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d70000 x1875771241029248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874983.275848:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241029248:0@lo:400: 00010000:00080000:3.0:1788874983.275860:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d72a00 x1875771241029120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874983.275868:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241029120:0@lo:400: 00010000:00080000:3.0:1788874983.279768:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d70a80 x1875771241028736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874983.279810:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241028736:0@lo:400: 00010000:00080000:2.0:1788874983.280266:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d71f80 x1875771241028864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874983.280279:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241028864:0@lo:400: 00000100:00100000:3.0:1788874983.758347:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788874983.758372:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241029376:0@lo:13: 00000100:00100000:3.0:1788874983.758445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874983.759203:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029376 00000100:00100000:1.0:1788874983.759214:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029376 00000100:00100000:1.0:1788874983.759289:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788874983.759300:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241029376:12345-0@lo:13: 00002000:00000024:1.0:1788874983.759334:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874983.759392:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241029376:12345-0@lo:13: Request processed in 94us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874983.759408:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788874983.762789:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d70a80 x1875771241029376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788874999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874983.762820:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241029376:0@lo:13: 00000001:00080000:3.0:1788874983.872652:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788874984.206022:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788874985.234212:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874985.691849:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874985.691891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217936512 00000100:00100000:1.0:1788874985.691910:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217936512 00000100:00100000:1.0:1788874985.691957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:1.0:1788874985.691966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875771217936512:12345-192.168.202.7@tcp:250: 00010000:00080000:1.0:1788874985.691996:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4f85827f-e9c9-452e-88ac-d3df48643465@192.168.202.7@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788874985.692024:0:5835:0:(genops.c:1385:class_connect()) connect: client 4f85827f-e9c9-452e-88ac-d3df48643465, cookie 0x60858e6020d821ca 00000100:00080000:1.0:1788874985.692159:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9e5a04842000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788874985.692227:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+5:2346:x1875771217936512:12345-192.168.202.7@tcp:250: Request processed in 260us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874985.692235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:1.0:1788874985.714822:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874985.714913:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217936640 00000100:00100000:3.0:1788874985.714923:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217936640 00000100:00100000:3.0:1788874985.714970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:3.0:1788874985.714980:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+5:5578:x1875771217936640:12345-192.168.202.7@tcp:101: 00010000:00010000:3.0:1788874985.714996:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874985.715014:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a09fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874985.715062:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874985.715073:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874985.715094:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14000, rc 0) 00000100:00100000:3.0:1788874985.715157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+6:5578:x1875771217936640:12345-192.168.202.7@tcp:101: Request processed in 178us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874985.715163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:1.0:1788874985.723325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.723394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217936768 00000100:00100000:2.0:1788874985.723404:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217936768 00000100:00100000:2.0:1788874985.723452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:2.0:1788874985.723460:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+6:5578:x1875771217936768:12345-192.168.202.7@tcp:501: 00000100:00100000:2.0:1788874985.724389:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+6:5578:x1875771217936768:12345-192.168.202.7@tcp:501: Request processed in 922us (1066us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788874985.724401:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:1.0:1788874985.751371:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874985.751452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217936896 00000100:00100000:0.0:1788874985.751463:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217936896 00000100:00100000:0.0:1788874985.751525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:0.0:1788874985.751548:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+6:5578:x1875771217936896:12345-192.168.202.7@tcp:101: 00010000:00010000:0.0:1788874985.751566:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874985.751583:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874985.751613:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874985.751624:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874985.751634:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031400, rc 0) 00000100:00100000:0.0:1788874985.751690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+7:5578:x1875771217936896:12345-192.168.202.7@tcp:101: Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874985.751698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:3.0:1788874985.763092:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.763183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937024 00000100:00100000:2.0:1788874985.763194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937024 00000100:00100000:2.0:1788874985.763256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:2.0:1788874985.763266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+7:5578:x1875771217937024:12345-192.168.202.7@tcp:501: 00000100:00100000:2.0:1788874985.763549:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+8:5578:x1875771217937024:12345-192.168.202.7@tcp:501: Request processed in 283us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874985.763557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:1.0:1788874985.772055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.772224:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937152 00000100:00100000:2.0:1788874985.772235:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937152 00000100:00100000:2.0:1788874985.772294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1788874985.772305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+8:5578:x1875771217937152:12345-192.168.202.7@tcp:503: 00000100:00100000:2.0:1788874985.772668:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+8:5578:x1875771217937152:12345-192.168.202.7@tcp:503: Request processed in 361us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874985.772677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:1.0:1788874985.778513:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.778596:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937280 00000100:00100000:2.0:1788874985.778606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937280 00000100:00100000:2.0:1788874985.778669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:2.0:1788874985.778681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+8:5598:x1875771217937280:12345-192.168.202.7@tcp:502: 00000100:00100000:2.0:1788874985.779064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+8:5598:x1875771217937280:12345-192.168.202.7@tcp:502: Request processed in 384us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874985.779073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:3.0:1788874985.841948:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874985.842388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937408 00000100:00100000:1.0:1788874985.842400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937408 00000100:00100000:1.0:1788874985.842458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:1.0:1788874985.842468:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+8:5598:x1875771217937408:12345-192.168.202.7@tcp:502: 00000100:00100000:1.0:1788874985.842748:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+8:5598:x1875771217937408:12345-192.168.202.7@tcp:502: Request processed in 280us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874985.842756:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:1.0:1788874985.856305:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.856498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937536 00000100:00100000:2.0:1788874985.856509:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937536 00000100:00100000:2.0:1788874985.856568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:2.0:1788874985.856578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+8:5578:x1875771217937536:12345-192.168.202.7@tcp:101: 00010000:00010000:2.0:1788874985.856597:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874985.856616:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a027ea800/0x60858e6020d821df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a2c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874985.856647:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a027ea800/0x60858e6020d821df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a2c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874985.856660:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a027ea800/0x60858e6020d821df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a2c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874985.856671:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a027ea800, rc 0) 00000100:00100000:2.0:1788874985.856739:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5578:x1875771217937536:12345-192.168.202.7@tcp:101: Request processed in 162us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874985.856747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:3.0:1788874985.863700:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.863877:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937664 00000100:00100000:2.0:1788874985.863890:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937664 00000100:00100000:2.0:1788874985.863959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:2.0:1788874985.863969:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+9:5578:x1875771217937664:12345-192.168.202.7@tcp:256: 20000000:01000000:2.0:1788874985.863998:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788874985.864024:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788874985.864034:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788874985.864044:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788874985.864047:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788874985.873329:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+9:5578:x1875771217937664:12345-192.168.202.7@tcp:256: Request processed in 9348us (9633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874985.873353:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:3.0:1788874985.879152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874985.879252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937792 00000100:00100000:1.0:1788874985.879263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937792 00000100:00100000:1.0:1788874985.879320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:1.0:1788874985.879329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5578:x1875771217937792:12345-192.168.202.7@tcp:101: 00010000:00010000:1.0:1788874985.879344:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874985.879362:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a33 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874985.879390:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874985.879401:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874985.879410:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26200, rc 0) 00000100:00100000:1.0:1788874985.879469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:5578:x1875771217937792:12345-192.168.202.7@tcp:101: Request processed in 141us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874985.879475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:3.0:1788874985.885303:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874985.885507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217937920 00000100:00100000:1.0:1788874985.885517:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217937920 00000100:00100000:1.0:1788874985.885571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:1.0:1788874985.885591:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5578:x1875771217937920:12345-192.168.202.7@tcp:501: 00000100:00100000:1.0:1788874985.886234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5578:x1875771217937920:12345-192.168.202.7@tcp:501: Request processed in 652us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874985.886242:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:0.0:1788874985.891272:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874985.891312:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938048 00000100:00100000:0.0:1788874985.891321:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938048 00000100:00100000:0.0:1788874985.891368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:0.0:1788874985.891377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5578:x1875771217938048:12345-192.168.202.7@tcp:503: 00000100:00100000:0.0:1788874985.891733:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5578:x1875771217938048:12345-192.168.202.7@tcp:503: Request processed in 355us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874985.891741:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:0.0:1788874985.896703:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874985.896889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938176 00000100:00100000:3.0:1788874985.896907:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938176 00000100:00100000:3.0:1788874985.896964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:3.0:1788874985.896975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:5603:x1875771217938176:12345-192.168.202.7@tcp:502: 00000100:00100000:3.0:1788874985.897466:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:5603:x1875771217938176:12345-192.168.202.7@tcp:502: Request processed in 489us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874985.897474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:1.0:1788874985.904692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874985.904812:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938304 00000100:00100000:2.0:1788874985.904823:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938304 00000100:00100000:2.0:1788874985.904878:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:2.0:1788874985.904888:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5603:x1875771217938304:12345-192.168.202.7@tcp:502: 00000100:00100000:2.0:1788874985.905144:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5603:x1875771217938304:12345-192.168.202.7@tcp:502: Request processed in 257us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874985.905152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:1.0:1788874985.910270:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874985.910373:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938432 00000100:00100000:3.0:1788874985.910383:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938432 00000100:00100000:3.0:1788874985.910437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1788874985.910447:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875771217938432:12345-192.168.202.7@tcp:38: 00010000:00080000:3.0:1788874985.910489:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788874985.910547:0:5843:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d821ed 00000004:00100000:3.0:1788874985.910579:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788874985.910585:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788874985.947392:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9e5a3546a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874985.947479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217938432:12345-192.168.202.7@tcp:38: Request processed in 37032us (37222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874985.947490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00010000:00010000:2.0:1788874986.254760:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874986.962084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874986.962187:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938688 00000100:00100000:3.0:1788874986.962199:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938688 00000100:00100000:3.0:1788874986.962300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1788874986.962312:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217938688:12345-192.168.202.7@tcp:41: 00000004:00000024:3.0:1788874986.962356:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788874986.962483:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217938688:12345-192.168.202.7@tcp:41: Request processed in 173us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874986.962490:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00080000:0.0:1788874986.963755:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874986.967178:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874986.967580:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938560 00000100:00100000:3.0:1788874986.967594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938560 00000100:00100000:3.0:1788874986.967662:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1788874986.967673:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:0:x1875771217938560:12345-192.168.202.7@tcp:41: 00000004:00000024:3.0:1788874986.967721:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788874986.967820:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:0:x1875771217938560:12345-192.168.202.7@tcp:41: Request processed in 148us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874986.967828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1788874986.974125:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874986.974374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938816 00000100:00100000:1.0:1788874986.974384:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938816 00000100:00100000:1.0:1788874986.974480:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788874986.974491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217938816:12345-192.168.202.7@tcp:40: 00000100:00100000:1.0:1788874986.974599:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217938816:12345-192.168.202.7@tcp:40: Request processed in 110us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874986.974606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1788874986.981857:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874986.981914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874986.982020:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217938944 00000100:00100000:3.0:1788874986.982037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217938944 00000100:00100000:3.0:1788874986.982090:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:3.0:1788874986.982096:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875771217938944:12345-192.168.202.7@tcp:8: 00010000:00080000:3.0:1788874986.982124:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1788874986.982150:0:6697:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d821f4 00002000:00100000:3.0:1788874986.982161:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd989c2b-3da6-48fe-ae0a-99ed44fd91eb/ffff9e5a3546b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788874986.982183:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788874986.982489:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788874986.982534:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e5a36169000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788874986.982618:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217938944:12345-192.168.202.7@tcp:8: Request processed in 519us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874986.982627:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1788874986.987350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939200 00000100:00100000:0.0:1788874986.987366:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939200 00000100:00100000:0.0:1788874986.987430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:0.0:1788874986.987457:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2350:x1875771217939200:12345-192.168.202.7@tcp:400: 00000100:00100000:0.0:1788874986.987556:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2350:x1875771217939200:12345-192.168.202.7@tcp:400: Request processed in 101us (5640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874986.987564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:3.0:1788874986.987797:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874986.987879:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788874986.987977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939328 00000100:00100000:2.0:1788874986.987982:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939328 00000100:00100000:2.0:1788874986.988023:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1788874986.988031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217939328:12345-192.168.202.7@tcp:33: 00000100:00100000:0.0:1788874986.990225:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939072 00000100:00100000:0.0:1788874986.990243:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939072 00000100:00100000:0.0:1788874986.990308:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1788874986.990318:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875771217939072:12345-192.168.202.7@tcp:8: 00010000:00080000:0.0:1788874986.990353:0:6901:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1788874986.990385:0:6901:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d821fb 00002000:00100000:0.0:1788874986.990398:0:6901:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd989c2b-3da6-48fe-ae0a-99ed44fd91eb/ffff9e5906b03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788874986.990424:0:6901:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788874986.991687:0:6901:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788874986.991733:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5906b04000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788874986.993959:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217939072:12345-192.168.202.7@tcp:8: Request processed in 3631us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874986.993973:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000004:00080000:0.0:1788874987.017806:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29714us 00000004:00200000:1.0:1788874987.071102:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788874987.071235:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5578:x1875771217939328:12345-192.168.202.7@tcp:33: Request processed in 83198us (83349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874987.071251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00010000:00010000:1.0:1788874987.277970:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874987.410378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874987.410544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939456 00000100:00100000:0.0:1788874987.410555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939456 00000100:00100000:0.0:1788874987.410627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1788874987.410638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5620:x1875771217939456:12345-192.168.202.7@tcp:101: 00010000:00010000:0.0:1788874987.410658:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874987.410800:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.410911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.410925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.410942:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788874987.410980:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788874987.410984:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788874987.411001:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.411027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a5d expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.411046:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a5d expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874987.411054:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:0.0:1788874987.411056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788874987.411060:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a421c3a00, rc 0) 00000100:00100000:0.0:1788874987.411281:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:5620:x1875771217939456:12345-192.168.202.7@tcp:101: Request processed in 644us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874987.411288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:2.0:1788874987.854143:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788874987.854172:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241029504:0@lo:13: 00000100:00100000:2.0:1788874987.854245:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874987.854532:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029504 00000100:00100000:1.0:1788874987.854541:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029504 00000100:00100000:1.0:1788874987.854602:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788874987.854625:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241029504:12345-0@lo:13: 00002000:00000024:1.0:1788874987.854647:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788874987.854701:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241029504:12345-0@lo:13: Request processed in 91us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874987.854708:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788874987.854926:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b2300 x1875771241029504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788874987.860647:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788874987.860794:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241029504:0@lo:13: 00010000:00010000:0.0:1788874988.305524:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874988.367154:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241029888:0@lo:400: 00000100:00100000:1.0:1788874988.367233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874988.367277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029888 00000100:00100000:1.0:1788874988.367300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029888 00000100:00100000:1.0:1788874988.367361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788874988.367372:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241029888:12345-0@lo:400: 00000100:00100000:2.0:1788874988.367474:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241029760:0@lo:400: 00000100:00100000:2.0:1788874988.367503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874988.367548:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788874988.367554:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241029632:0@lo:400: 00000100:00100000:2.0:1788874988.367582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874988.367621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029632 00000100:00100000:2.0:1788874988.367624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029632 00000100:00100000:2.0:1788874988.367646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788874988.367652:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241029632:12345-0@lo:400: 00000100:00100000:2.0:1788874988.367682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241029632:12345-0@lo:400: Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874988.367688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788874988.367728:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241029632:0@lo:400: 00000100:00080000:0.0:1788874988.367857:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788874988.368040:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788874988.368048:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788874988.368138:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241029760 00000100:00100000:0.0:1788874988.368141:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241029760 00000100:00100000:0.0:1788874988.368160:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788874988.368166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788874988.368171:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241029760:12345-0@lo:400: 00000100:00100000:0.0:1788874988.368211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241029760:12345-0@lo:400: Request processed in 41us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874988.368217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788874988.368350:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241029760:0@lo:400: 00000100:00100000:0.0:1788874988.368371:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241030016:0@lo:400: 00000100:00100000:0.0:1788874988.368401:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874988.368434:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030016 00000100:00100000:0.0:1788874988.368437:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030016 00000100:00100000:0.0:1788874988.368460:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788874988.368466:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241030016:12345-0@lo:400: 00000100:00100000:0.0:1788874988.368499:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241030016:12345-0@lo:400: Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874988.368504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788874988.368530:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d70e00 x1875771241030016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874988.368540:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241030016:0@lo:400: 00000100:00100000:1.0:1788874988.371619:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241029888:12345-0@lo:400: Request processed in 4238us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874988.371634:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788874988.371796:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241029888:0@lo:400: 00000100:00100000:3.0:1788874988.373618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241030272:0@lo:400: 00000100:00100000:3.0:1788874988.373690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874988.373725:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788874988.373732:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241030144:0@lo:400: 00000100:00100000:3.0:1788874988.373758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874988.373815:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030272 00000100:00100000:3.0:1788874988.373822:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030272 00000100:00100000:3.0:1788874988.373888:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788874988.373897:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241030272:12345-0@lo:400: 00000100:00100000:3.0:1788874988.373949:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241030272:12345-0@lo:400: Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874988.373956:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788874988.373980:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874988.374009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030144 00000100:00100000:3.0:1788874988.374012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030144 00000100:00100000:3.0:1788874988.374038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788874988.374044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241030144:12345-0@lo:400: 00000100:00100000:3.0:1788874988.374074:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241030144:12345-0@lo:400: Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874988.374079:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788874988.374091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788874988.374112:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241030144:0@lo:400: 00010000:00080000:3.0:1788874988.374125:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d71c00 x1875771241030272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874988.374135:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788874988.374149:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241030272:0@lo:400: 00000100:00100000:2.0:1788874988.878141:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241030400:0@lo:13: 00000100:00100000:2.0:1788874988.878252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874988.878458:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030400 00000100:00100000:3.0:1788874988.878467:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030400 00000100:00100000:3.0:1788874988.878521:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788874988.878533:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241030400:12345-0@lo:13: 00002000:00000024:3.0:1788874988.878570:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788874988.878632:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241030400:12345-0@lo:13: Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874988.878639:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788874988.878721:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d71c00 x1875771241030400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788874988.878741:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241030400:0@lo:13: 00010000:00010000:1.0:1788874989.327248:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874989.787533:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874989.787635:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939584 00000100:00100000:0.0:1788874989.787645:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939584 00000100:00100000:0.0:1788874989.787825:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1788874989.787835:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:5672:x1875771217939584:12345-192.168.202.7@tcp:41: 00000004:00000024:0.0:1788874989.787911:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788874989.787996:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:5672:x1875771217939584:12345-192.168.202.7@tcp:41: Request processed in 161us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874989.788003:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:3.0:1788874989.791023:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788874989.798017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874989.798147:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939712 00000100:00100000:3.0:1788874989.798157:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939712 00000100:00100000:3.0:1788874989.798242:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1788874989.798253:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5672:x1875771217939712:12345-192.168.202.7@tcp:13: 00002000:00000024:3.0:1788874989.798308:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788874989.798506:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874989.798578:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5672:x1875771217939712:12345-192.168.202.7@tcp:13: Request processed in 327us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874989.798588:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788874989.811933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874989.812331:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939840 00000100:00100000:3.0:1788874989.812341:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939840 00000100:00100000:3.0:1788874989.812421:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1788874989.812432:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5672:x1875771217939840:12345-192.168.202.7@tcp:13: 00002000:00000024:3.0:1788874989.812462:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788874989.812552:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:5672:x1875771217939840:12345-192.168.202.7@tcp:13: Request processed in 114us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874989.812560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00080000:0.0:1788874989.813303:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788874990.352280:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788874991.029869:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00010000:00010000:2.0:1788874991.381012:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788874991.476797:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000001:00100000:2.0:1788874992.038187:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00010000:00010000:2.0:1788874992.398624:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788874992.429004:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874992.429054:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874992.429107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874992.429139:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788874992.429182:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940224 00000100:00100000:1.0:1788874992.429195:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940224 00000100:00100000:1.0:1788874992.429259:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940352 00000100:00100000:1.0:1788874992.429262:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940352 00000100:00100000:1.0:1788874992.429286:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788874992.429299:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940224:12345-192.168.202.7@tcp:400: 00000100:00100000:1.0:1788874992.429384:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940224:12345-192.168.202.7@tcp:400: Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874992.429393:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788874992.429412:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1788874992.429420:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940352:12345-192.168.202.7@tcp:400: 00000100:00100000:1.0:1788874992.429454:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940352:12345-192.168.202.7@tcp:400: Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874992.429461:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:1.0:1788874992.429480:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788874992.429486:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788874992.429903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217939968 00000100:00100000:3.0:1788874992.429909:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217939968 00000100:00100000:3.0:1788874992.429953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00100000:3.0:1788874992.429962:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217939968:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1788874992.430001:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217939968:12345-192.168.202.7@tcp:400: Request processed in 41us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874992.430008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00100000:3.0:1788874992.430043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940096 00000100:00100000:3.0:1788874992.430046:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940096 00000100:00100000:3.0:1788874992.430080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1788874992.430086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217940096:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1788874992.430116:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217940096:12345-192.168.202.7@tcp:400: Request processed in 29us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874992.430131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00080000:3.0:1788874992.430241:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788874992.976170:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788874992.976198:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241030528:0@lo:13: 00000100:00100000:3.0:1788874992.976279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874992.977092:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030528 00000100:00100000:0.0:1788874992.977102:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030528 00000100:00100000:0.0:1788874992.977167:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788874992.977177:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241030528:12345-0@lo:13: 00002000:00000024:0.0:1788874992.977215:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788874992.977273:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241030528:12345-0@lo:13: Request processed in 97us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874992.977281:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788874992.977338:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788874992.977382:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02ed80 x1875771241030528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874992.977412:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241030528:0@lo:13: 00000001:02000400:1.0:1788874993.138311:0:8305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788874993.421964:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788874993.487018:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241030912:0@lo:400: 00000100:00100000:2.0:1788874993.487091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874993.487115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241030784:0@lo:400: 00000100:00100000:3.0:1788874993.487155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874993.487158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788874993.487167:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241031040:0@lo:400: 00000100:00100000:3.0:1788874993.487183:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241031296:0@lo:400: 00000100:00100000:2.0:1788874993.487197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874993.487240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874993.487277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788874993.487279:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030912 00000100:00100000:3.0:1788874993.487285:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241030656:0@lo:400: 00000100:00100000:2.0:1788874993.487288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030912 00000100:00100000:3.0:1788874993.487317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874993.487342:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241031168:0@lo:400: 00000100:00100000:2.0:1788874993.487354:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030784 00000100:00100000:2.0:1788874993.487359:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030784 00000100:00100000:3.0:1788874993.487368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874993.487439:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031040 00000100:00100000:0.0:1788874993.487444:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031040 00000100:00100000:0.0:1788874993.487474:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031296 00000100:00100000:0.0:1788874993.487477:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031296 00000100:00100000:0.0:1788874993.487501:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874993.487520:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241031040:12345-0@lo:400: 00000100:00100000:0.0:1788874993.487578:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241031040:12345-0@lo:400: Request processed in 69us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874993.487585:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788874993.487601:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874993.487607:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241031296:12345-0@lo:400: 00000100:00100000:0.0:1788874993.487634:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241031296:12345-0@lo:400: Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874993.487650:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788874993.487668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241030656 00000100:00100000:0.0:1788874993.487671:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241030656 00000100:00100000:0.0:1788874993.487695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788874993.487701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241030656:12345-0@lo:400: 00000100:00100000:0.0:1788874993.487730:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241030656:12345-0@lo:400: Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874993.487736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:3.0:1788874993.487812:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02d880 x1875771241031296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874993.487834:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241031296:0@lo:400: 00000100:00100000:3.0:1788874993.487854:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241030656:0@lo:400: 00000100:00080000:3.0:1788874993.487870:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788874993.487875:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788874993.494785:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031168 00000100:00100000:2.0:1788874993.494801:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031168 00000100:00100000:2.0:1788874993.494916:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788874993.494928:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241030912:12345-0@lo:400: 00000100:00100000:2.0:1788874993.495024:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241030912:12345-0@lo:400: Request processed in 98us (7932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874993.495032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788874993.495048:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788874993.495054:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241030784:12345-0@lo:400: 00000100:00100000:2.0:1788874993.495090:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241030784:12345-0@lo:400: Request processed in 36us (7935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874993.495096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788874993.495107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788874993.495113:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241031168:12345-0@lo:400: 00000100:00100000:2.0:1788874993.495139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241031168:12345-0@lo:400: Request processed in 26us (7771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874993.495145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788874993.495193:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788874993.495241:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02dc00 x1875771241031040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788874993.495247:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241031168:0@lo:400: 00000100:00100000:0.0:1788874993.495264:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241031040:0@lo:400: 00000100:00100000:2.0:1788874993.495269:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241030784:0@lo:400: 00000100:00100000:0.0:1788874993.495286:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241030912:0@lo:400: 00000100:00100000:2.0:1788874994.005027:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788874994.005059:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241031424:0@lo:13: 00000100:00100000:2.0:1788874994.005287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874994.008521:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031424 00000100:00100000:3.0:1788874994.008537:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031424 00000100:00100000:3.0:1788874994.009308:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874994.009322:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241031424:12345-0@lo:13: 00002000:00000024:3.0:1788874994.009358:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788874994.009446:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241031424:12345-0@lo:13: Request processed in 128us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874994.009453:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788874994.014295:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d71c00 x1875771241031424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874994.014327:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241031424:0@lo:13: 00010000:00010000:0.0:1788874994.447167:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874995.470967:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788874996.494118:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788874997.519057:0:8454:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9c7da440 20000000:00000080:1.0:1788874997.519081:0:8454:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a3c526400 uarg=0000000000000000 20000000:01000000:1.0:1788874997.519135:0:8454:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788874997.519138:0:8454:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788874997.519141:0:8454:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788874997.519147:0:8454:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788874997.519153:0:8454:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788874997.519172:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788874997.519174:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788874997.519469:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788874997.519472:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00010000:00010000:2.0:1788874997.520225:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788874997.520632:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788874997.522516:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788874997.522601:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788874997.522636:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788874997.522651:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788874997.522655:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788874997.524237:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788874997.525329:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788874997.525396:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788874997.525459:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788874997.525480:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788874997.525483:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000100:00100000:3.0:1788874997.533445:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874997.533506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874997.533542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874997.533612:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788874997.533647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940608 00000100:00100000:3.0:1788874997.533661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940608 00000100:00100000:3.0:1788874997.533751:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788874997.533764:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217940608:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1788874997.533962:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217940608:12345-192.168.202.7@tcp:400: Request processed in 200us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.533972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788874997.534005:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940736 00000100:00100000:3.0:1788874997.534009:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940736 00000100:00100000:3.0:1788874997.534037:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940864 00000100:00100000:3.0:1788874997.534040:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940864 00000100:00100000:3.0:1788874997.534063:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1788874997.534069:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940736:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1788874997.534099:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940736:12345-192.168.202.7@tcp:400: Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.534106:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1788874997.534140:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1788874997.534147:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940864:12345-192.168.202.7@tcp:400: 00000100:00100000:3.0:1788874997.534176:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217940864:12345-192.168.202.7@tcp:400: Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.534183:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00080000:3.0:1788874997.534202:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788874997.534207:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788874997.534211:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788874997.534665:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940480 00000100:00100000:2.0:1788874997.534673:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940480 00000100:00100000:2.0:1788874997.534716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:2.0:1788874997.534726:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217940480:12345-192.168.202.7@tcp:400: 00000100:00100000:2.0:1788874997.534766:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217940480:12345-192.168.202.7@tcp:400: Request processed in 43us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874997.534800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 132 00000040:00080000:1.0:1788874997.541238:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788874997.543534:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788874997.543608:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788874997.543643:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788874997.543662:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788874997.543675:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788874997.546059:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788874997.546759:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788874997.547283:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788874997.547328:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788874997.547352:0:8454:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788874997.547379:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547419:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82106 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547427:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547434:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8215a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547442:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82168 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547449:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82176 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547457:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82192 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547464:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d821bc expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547475:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547483:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547492:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547562:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547583:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 9 pid: 5834 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874997.547600:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031552:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788874997.547745:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874997.547755:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 9 pid: 5833 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874997.547764:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031680:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788874997.552302:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552329:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 18 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552348:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031808:0@lo:104: 00000100:00100000:0.0:1788874997.552449:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788874997.552526:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552535:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 18 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552544:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031936:0@lo:104: 00000100:00100000:0.0:1788874997.552573:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788874997.552597:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552605:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 18 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552613:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032064:0@lo:104: 00010000:00010000:0.0:1788874997.552639:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552647:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 18 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552682:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032192:0@lo:104: 00010000:00010000:0.0:1788874997.552714:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552722:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552730:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032320:0@lo:104: 00010000:00010000:0.0:1788874997.552757:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552765:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552811:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032448:0@lo:104: 00010000:00010000:0.0:1788874997.552859:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.552868:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 18 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.552877:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032576:0@lo:104: 00000100:00100000:0.0:1788874997.552899:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1964cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788874997.553219:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788874997.553243:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.553257:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.553266:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.553287:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.553297:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.553306:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031808 00000100:00100000:3.0:1788874997.553316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031808 00000100:00100000:3.0:1788874997.553367:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241031936 00000100:00100000:3.0:1788874997.553370:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241031936 00000100:00100000:3.0:1788874997.553381:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032064 00000100:00100000:3.0:1788874997.553384:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032064 00000100:00100000:3.0:1788874997.553391:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032192 00000100:00100000:3.0:1788874997.553393:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032192 00000100:00100000:3.0:1788874997.553401:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032320 00000100:00100000:3.0:1788874997.553403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032320 00000100:00100000:3.0:1788874997.553411:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032448 00000100:00100000:3.0:1788874997.553414:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032448 00000100:00100000:3.0:1788874997.553423:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032576 00000100:00100000:3.0:1788874997.553425:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032576 00000100:00100000:3.0:1788874997.553439:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874997.553449:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+9:8454:x1875771241031808:12345-0@lo:104: 00010000:00010000:3.0:1788874997.553467:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.553543:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788874997.553551:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+9:8454:x1875771241031808:12345-0@lo:104: Request processed in 103us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.553560:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788874997.553587:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874997.553593:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35c07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+8:8454:x1875771241031936:12345-0@lo:104: 00010000:00010000:3.0:1788874997.553602:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.553636:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788874997.553641:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35c07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+8:8454:x1875771241031936:12345-0@lo:104: Request processed in 49us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.553647:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788874997.553699:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874997.553705:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+7:8454:x1875771241032064:12345-0@lo:104: 00010000:00010000:3.0:1788874997.553713:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.553746:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788874997.553751:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+7:8454:x1875771241032064:12345-0@lo:104: Request processed in 48us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.553757:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874997.553815:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874997.553822:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+6:8454:x1875771241032192:12345-0@lo:104: 00010000:00010000:3.0:1788874997.553830:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.553872:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788874997.553878:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+6:8454:x1875771241032192:12345-0@lo:104: Request processed in 57us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.553884:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874997.553911:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874997.553918:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+5:8454:x1875771241032320:12345-0@lo:104: 00010000:00010000:3.0:1788874997.554077:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.554108:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788874997.554113:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+5:8454:x1875771241032320:12345-0@lo:104: Request processed in 196us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.554119:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788874997.554269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874997.554310:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788874997.554337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941120 00000100:00100000:0.0:1788874997.554343:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941120 00010000:00010000:0.0:1788874997.554379:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 10 pid: 5833 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.554404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217940992 00000100:00100000:0.0:1788874997.554407:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217940992 00010000:00010000:0.0:1788874997.554419:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 11 pid: 5834 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.554432:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788874997.554438:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+11:2348:x1875771217941120:12345-192.168.202.7@tcp:103: 00010000:00010000:0.0:1788874997.554451:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874997.554457:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 11 pid: 5833 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.554470:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 11 pid: 5833 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.554495:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874997.554544:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+11:2348:x1875771217941120:12345-192.168.202.7@tcp:103: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874997.554551:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788874997.554565:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788874997.554572:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217940992:12345-192.168.202.7@tcp:103: 00010000:00010000:0.0:1788874997.554579:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788874997.554584:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 10 pid: 5834 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.554596:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 10 pid: 5834 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.554618:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788874997.554637:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217940992:12345-192.168.202.7@tcp:103: Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874997.554644:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00010000:00010000:0.0:1788874997.554700:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031400/0x60858e6020d821d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a02 expref: 9 pid: 5834 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.554719:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031552:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788874997.554732:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14000/0x60858e6020d821d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a09fb expref: 8 pid: 5833 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874997.554740:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031680:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788874997.554751:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031808:0@lo:104: 00000100:00100000:0.0:1788874997.554759:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241031936:0@lo:104: 00000100:00100000:0.0:1788874997.554767:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032064:0@lo:104: 00000100:00100000:0.0:1788874997.554808:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032192:0@lo:104: 00000100:00100000:0.0:1788874997.554817:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032320:0@lo:104: 00000100:00100000:3.0:1788874997.554908:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788874997.554917:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:8454:x1875771241032448:12345-0@lo:104: 00010000:00010000:3.0:1788874997.554927:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.554970:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788874997.554975:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+4:8454:x1875771241032448:12345-0@lo:104: Request processed in 61us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.554980:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788874997.554995:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788874997.555000:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:8454:x1875771241032576:12345-0@lo:104: 00010000:00010000:3.0:1788874997.555008:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555042:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788874997.555046:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:8454:x1875771241032576:12345-0@lo:104: Request processed in 47us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.555052:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788874997.555072:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788874997.555079:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555087:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555093:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555103:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555110:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555117:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555154:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555161:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555184:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555191:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d821bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d821c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555216:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788874997.555220:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555225:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb600 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555228:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555234:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555240:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555245:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555258:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555264:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555280:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555287:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb600/0x60858e6020d82192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82199 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555298:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788874997.555301:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555316:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eae00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555319:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555326:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555332:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555337:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555351:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555357:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555363:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555369:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eae00/0x60858e6020d82176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8217d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555380:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788874997.555383:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555388:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555391:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555407:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555414:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555420:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555435:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555441:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555446:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555453:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d82168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8216f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555463:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788874997.555466:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555474:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555477:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555483:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555489:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555500:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555514:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555520:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555524:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555531:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8215a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82161 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555540:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788874997.555543:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555549:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555552:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555559:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555566:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555571:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555583:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555589:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555598:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555604:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb200/0x60858e6020d82130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82137 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555612:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788874997.555614:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555619:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26400 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788874997.555622:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555628:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788874997.555632:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874997.555637:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788874997.555650:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555655:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788874997.555659:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555665:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26400/0x60858e6020d82106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8210d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.555679:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874997.555685:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874997.555688:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874997.555697:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874997.555704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788874997.555712:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874997.555752:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241032704:0@lo:103: 00000100:00100000:3.0:1788874997.555850:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874997.557095:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241033088:0@lo:103: 00000100:00100000:0.0:1788874997.557324:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032448:0@lo:104: 00000100:00100000:0.0:1788874997.557337:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1875771241032576:0@lo:104: 00010000:00010000:0.0:1788874997.557410:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.557749:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241033216:0@lo:103: 00000100:00100000:3.0:1788874997.557811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.557857:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241032832:0@lo:103: 00000100:00100000:3.0:1788874997.557882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.557900:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241033344:0@lo:103: 00000100:00100000:3.0:1788874997.557922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.557935:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788874997.557942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241032960:0@lo:103: 00000100:00100000:3.0:1788874997.557964:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.557975:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241033472:0@lo:103: 00000100:00100000:3.0:1788874997.557993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874997.558026:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032704 00000100:00100000:3.0:1788874997.558035:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032704 00010000:00010000:3.0:1788874997.558079:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 19 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558106:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033216 00000100:00100000:3.0:1788874997.558110:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033216 00010000:00010000:3.0:1788874997.558121:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 20 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558131:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032832 00000100:00100000:3.0:1788874997.558149:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032832 00010000:00010000:3.0:1788874997.558161:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 21 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558173:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033344 00000100:00100000:3.0:1788874997.558175:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033344 00010000:00010000:3.0:1788874997.558186:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 22 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558196:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241032960 00000100:00100000:3.0:1788874997.558198:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241032960 00010000:00010000:3.0:1788874997.558213:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 23 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033472 00000100:00100000:3.0:1788874997.558225:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033472 00010000:00010000:3.0:1788874997.558236:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 24 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.558252:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874997.558263:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+24:3304:x1875771241032704:12345-0@lo:103: 00010000:00010000:3.0:1788874997.558286:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874997.558293:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 24 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558306:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 24 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558333:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d821c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d821bc expref: 24 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558353:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874997.558400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+23:3304:x1875771241032704:12345-0@lo:103: Request processed in 138us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.558408:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874997.558429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874997.558435:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+22:3304:x1875771241033216:12345-0@lo:103: 00010000:00010000:3.0:1788874997.558443:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874997.558448:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 22 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558456:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 22 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558466:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d82161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8215a expref: 22 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558477:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874997.558497:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+21:3304:x1875771241033216:12345-0@lo:103: Request processed in 62us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.558503:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874997.558515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874997.558521:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+20:3305:x1875771241032832:12345-0@lo:103: 00010000:00010000:3.0:1788874997.558529:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874997.558533:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 20 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558541:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 20 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558553:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027eb400/0x60858e6020d82199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82192 expref: 20 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558570:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874997.558598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241032832:12345-0@lo:103: Request processed in 78us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.558605:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788874997.558619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788874997.558624:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+18:3305:x1875771241033344:12345-0@lo:103: 00010000:00010000:3.0:1788874997.558633:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874997.558637:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558645:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558654:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027eac00/0x60858e6020d82137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82130 expref: 18 pid: 5835 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558665:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788874997.558687:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+17:3305:x1875771241033344:12345-0@lo:103: Request processed in 63us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.558695:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788874997.558708:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788874997.558714:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3305:x1875771241032960:12345-0@lo:103: 00010000:00010000:3.0:1788874997.558722:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788874997.558726:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558734:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558751:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027ea000/0x60858e6020d8217d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82176 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874997.558759:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788874997.559095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874997.559164:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788874997.559176:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788874997.563939:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788874997.563968:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033088 00000100:00100000:2.0:1788874997.563982:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033088 00010000:00010000:2.0:1788874997.564035:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874997.564067:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788874997.564077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788874997.564089:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3305:x1875771241033472:12345-0@lo:103: 00010000:00010000:2.0:1788874997.564111:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874997.564118:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564131:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564154:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030200/0x60858e6020d8210d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82106 expref: 16 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564200:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874997.564282:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+15:3305:x1875771241033472:12345-0@lo:103: Request processed in 194us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874997.564289:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788874997.564314:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788874997.564321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788874997.564327:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+14:3303:x1875771241033088:12345-0@lo:103: 00010000:00010000:2.0:1788874997.564336:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788874997.564340:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564349:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564360:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00030400/0x60858e6020d8216f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82168 expref: 14 pid: 5834 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564373:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564385:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564402:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564411:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564431:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564438:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564445:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788874997.564450:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.564460:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.564599:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+13:3305:x1875771241032960:12345-0@lo:103: Request processed in 5883us (6631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874997.564609:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788874997.564663:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241032960:0@lo:103: 00000100:00100000:3.0:1788874997.564676:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241033472:0@lo:103: 00000100:00100000:3.0:1788874997.564686:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241032832:0@lo:103: 00000100:00100000:3.0:1788874997.564695:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241033344:0@lo:103: 00010000:00010000:0.0:1788874997.570304:0:8454:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874997.570356:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874997.571107:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241032704:0@lo:103: 00000100:00100000:3.0:1788874997.571123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241033216:0@lo:103: 00010000:00010000:2.0:1788874997.572372:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.572393:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82210 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874997.572712:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788874997.574126:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3303:x1875771241033088:12345-0@lo:103: Request processed in 9786us (15019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874997.574142:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788874997.574489:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241033088:0@lo:103: 00000100:00100000:0.0:1788874998.094283:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241033600:0@lo:13: 00000100:00100000:0.0:1788874998.094365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874998.094586:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033600 00000100:00100000:2.0:1788874998.094596:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033600 00000100:00100000:2.0:1788874998.094685:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788874998.094695:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241033600:12345-0@lo:13: 00002000:00000024:2.0:1788874998.094730:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788874998.094810:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241033600:12345-0@lo:13: Request processed in 116us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874998.094833:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788874998.095017:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788874998.095057:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02fb80 x1875771241033600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874998.095081:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241033600:0@lo:13: 00010000:00010000:3.0:1788874998.542287:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788874998.608866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241033984:0@lo:400: 00000100:00100000:3.0:1788874998.608941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609025:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788874998.609032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241033856:0@lo:400: 00000100:00100000:3.0:1788874998.609058:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609076:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241034368:0@lo:400: 00000100:00100000:3.0:1788874998.609102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609146:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034368 00000100:00100000:3.0:1788874998.609153:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034368 00000100:00100000:3.0:1788874998.609233:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874998.609243:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241034368:12345-0@lo:400: 00000100:00100000:3.0:1788874998.609295:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241034368:12345-0@lo:400: Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874998.609302:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788874998.609342:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241033728:0@lo:400: 00000100:00100000:3.0:1788874998.609373:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609393:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241034240:0@lo:400: 00000100:00100000:3.0:1788874998.609415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609433:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788874998.609438:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241034112:0@lo:400: 00000100:00100000:3.0:1788874998.609458:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874998.609482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033984 00000100:00100000:3.0:1788874998.609486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033984 00000100:00100000:3.0:1788874998.609513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033856 00000100:00100000:3.0:1788874998.609516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033856 00000100:00100000:3.0:1788874998.609526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034240 00000100:00100000:3.0:1788874998.609529:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034240 00000100:00100000:3.0:1788874998.609543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788874998.609549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241033984:12345-0@lo:400: 00000100:00100000:3.0:1788874998.609580:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241033984:12345-0@lo:400: Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874998.609586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788874998.609597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788874998.609603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241033856:12345-0@lo:400: 00000100:00100000:3.0:1788874998.609629:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241033856:12345-0@lo:400: Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874998.609644:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788874998.609656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788874998.609662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241034240:12345-0@lo:400: 00000100:00100000:3.0:1788874998.609694:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241034240:12345-0@lo:400: Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874998.609699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788874998.609715:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034112 00000100:00100000:3.0:1788874998.609718:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034112 00000100:00100000:3.0:1788874998.609738:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788874998.609744:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241034112:12345-0@lo:400: 00000100:00100000:3.0:1788874998.609840:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241034112:12345-0@lo:400: Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874998.609846:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788874998.609883:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3f7f8700 x1875771241034112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874998.609899:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241034112:0@lo:400: 00000100:00100000:3.0:1788874998.609909:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241034240:0@lo:400: 00000100:00100000:3.0:1788874998.609937:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241033856:0@lo:400: 00010000:00080000:3.0:1788874998.609946:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3f7f8a80 x1875771241034368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788874998.609955:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241034368:0@lo:400: 00000100:00100000:3.0:1788874998.609963:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241033984:0@lo:400: 00000100:00100000:0.0:1788874998.610336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241033728 00000100:00100000:0.0:1788874998.610343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241033728 00000100:00100000:0.0:1788874998.610382:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788874998.610390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3304:x1875771241033728:12345-0@lo:400: 00000100:00100000:0.0:1788874998.610438:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+12:3304:x1875771241033728:12345-0@lo:400: Request processed in 49us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874998.610445:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788874998.610476:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788874998.610481:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788874998.610599:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241033728:0@lo:400: 00000100:00100000:0.0:1788874999.120293:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241034496:0@lo:13: 00000100:00100000:0.0:1788874999.120374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.120447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034496 00000100:00100000:2.0:1788874999.120456:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034496 00000100:00100000:2.0:1788874999.120508:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788874999.120518:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241034496:12345-0@lo:13: 00002000:00000024:2.0:1788874999.120554:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788874999.120615:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241034496:12345-0@lo:13: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.120622:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788874999.121977:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58ea00 x1875771241034496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788874999.122000:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241034496:0@lo:13: 10000000:01000000:3.0:1788874999.181905:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788874999.181917:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5904e88000 from 39 10000000:01000000:3.0:1788874999.181923:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788874999.181979:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.181992:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.182005:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.184612:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034624:0@lo:101: 00000100:00100000:3.0:1788874999.184707:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.184808:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.184903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034624 00000100:00100000:0.0:1788874999.184923:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034624 00000100:00100000:0.0:1788874999.184981:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788874999.184991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+12:5838:x1875771241034624:12345-0@lo:101: 00010000:00010000:0.0:1788874999.185008:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874999.185195:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a421c3600/0x60858e6020d8221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82217 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.185223:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a421c3600/0x60858e6020d8221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82217 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.185235:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a421c3600/0x60858e6020d8221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82217 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.185245:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a421c3600, rc 0) 00000100:00100000:0.0:1788874999.185299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241034624:12345-0@lo:101: Request processed in 310us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.185306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788874999.185399:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034624:0@lo:101: 00010000:00010000:3.0:1788874999.185416:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.185425:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.185485:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034752:0@lo:501: 00000100:00100000:3.0:1788874999.185511:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.185542:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.185591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034752 00000100:00100000:2.0:1788874999.185596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034752 00000100:00100000:2.0:1788874999.185626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788874999.185634:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241034752:12345-0@lo:501: 00000100:00100000:2.0:1788874999.185909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241034752:12345-0@lo:501: Request processed in 275us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.185916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788874999.185987:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034752:0@lo:501: 00000100:00100000:3.0:1788874999.186015:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034880:0@lo:503: 00000100:00100000:3.0:1788874999.186172:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.186213:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.186275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241034880 00000100:00100000:1.0:1788874999.186280:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241034880 00000100:00100000:1.0:1788874999.186315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788874999.186323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241034880:12345-0@lo:503: 00000100:00100000:1.0:1788874999.186471:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241034880:12345-0@lo:503: Request processed in 149us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.186477:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788874999.187602:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241034880:0@lo:503: 00000100:00100000:2.0:1788874999.188196:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8471:1875771241035008:0@lo:502: 00000100:00100000:2.0:1788874999.188265:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.188307:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876780 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.188357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035008 00000100:00100000:1.0:1788874999.188363:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035008 00000100:00100000:1.0:1788874999.188400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788874999.188407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:8471:x1875771241035008:12345-0@lo:502: 00000100:00100000:1.0:1788874999.188641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+13:8471:x1875771241035008:12345-0@lo:502: Request processed in 233us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.188655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788874999.189423:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8471:1875771241035008:0@lo:502: 00000100:00100000:3.0:1788874999.189486:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8471:1875771241035136:0@lo:502: 00000100:00100000:3.0:1788874999.189531:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.189568:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.189633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035136 00000100:00100000:2.0:1788874999.189639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035136 00000100:00100000:2.0:1788874999.189679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788874999.189687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:8471:x1875771241035136:12345-0@lo:502: 00000100:00100000:2.0:1788874999.189930:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+13:8471:x1875771241035136:12345-0@lo:502: Request processed in 243us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.189938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788874999.190042:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8471:1875771241035136:0@lo:502: 00000040:00080000:3.0:1788874999.190065:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788874999.190307:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788874999.190325:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788874999.190334:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.190346:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874999.190355:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788874999.190358:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788874999.190361:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788874999.190386:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.190394:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.190404:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874999.190418:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035264:0@lo:101: 00000100:00100000:2.0:1788874999.190447:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.190478:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.190593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035264 00000100:00100000:0.0:1788874999.190599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035264 00000100:00100000:0.0:1788874999.190624:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788874999.190632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+13:5838:x1875771241035264:12345-0@lo:101: 00010000:00010000:0.0:1788874999.190643:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788874999.190657:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a421c2a00/0x60858e6020d8222c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82225 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.190678:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a421c2a00/0x60858e6020d8222c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82225 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.190689:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a421c2a00/0x60858e6020d8222c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82225 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.190710:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a421c2a00, rc 0) 00000100:00100000:0.0:1788874999.190753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035264:12345-0@lo:101: Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.190759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788874999.190863:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035264:0@lo:101: 00010000:00010000:2.0:1788874999.190875:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.190885:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874999.190942:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035392:0@lo:501: 00000100:00100000:2.0:1788874999.190965:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.190994:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.191053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035392 00000100:00100000:0.0:1788874999.191057:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035392 00000100:00100000:0.0:1788874999.191074:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788874999.191079:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035392:12345-0@lo:501: 00000100:00100000:0.0:1788874999.191334:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035392:12345-0@lo:501: Request processed in 253us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.191341:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788874999.191483:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035392:0@lo:501: 00000100:00100000:2.0:1788874999.191509:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035520:0@lo:503: 00000100:00100000:2.0:1788874999.191546:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.191567:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.191656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035520 00000100:00100000:0.0:1788874999.191660:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035520 00000100:00100000:0.0:1788874999.191678:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788874999.191684:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035520:12345-0@lo:503: 00000100:00100000:0.0:1788874999.191967:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035520:12345-0@lo:503: Request processed in 281us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.191973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788874999.192712:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035520:0@lo:503: 00000100:00100000:2.0:1788874999.193285:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8472:1875771241035648:0@lo:502: 00000100:00100000:2.0:1788874999.193339:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.193381:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815780 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.193437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035648 00000100:00100000:1.0:1788874999.193444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035648 00000100:00100000:1.0:1788874999.193486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788874999.193497:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:8472:x1875771241035648:12345-0@lo:502: 00000100:00100000:1.0:1788874999.193683:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+14:8472:x1875771241035648:12345-0@lo:502: Request processed in 187us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.193690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788874999.193768:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8472:1875771241035648:0@lo:502: 00000020:01000000:2.0:1788874999.193824:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874999.193833:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874999.193836:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788874999.193840:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788874999.193859:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8472:1875771241035776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.193889:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.193904:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815780 going to sleep for 11 seconds 00000100:00100000:3.0:1788874999.193962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035776 00000100:00100000:3.0:1788874999.193967:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035776 00000100:00100000:3.0:1788874999.193989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788874999.193995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:8472:x1875771241035776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.194267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:8472:x1875771241035776:12345-0@lo:502:llog_process_th.0 Request processed in 271us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874999.194274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788874999.194342:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8472:1875771241035776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788874999.194359:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874999.194363:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874999.194365:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788874999.194369:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788874999.194552:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788874999.194570:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788874999.194580:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.194591:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874999.194600:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788874999.194603:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a07881000 from 39 10000000:01000000:3.0:1788874999.194605:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788874999.194629:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.194643:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.194651:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.194664:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.194691:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.194722:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.194763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241035904 00000100:00100000:2.0:1788874999.194768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241035904 00000100:00100000:2.0:1788874999.194833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788874999.194839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+14:5838:x1875771241035904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788874999.194850:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874999.194862:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18000/0x60858e6020d8223a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82233 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.194884:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18000/0x60858e6020d8223a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82233 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.194895:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18000/0x60858e6020d8223a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82233 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.194905:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18000, rc 0) 00000100:00100000:2.0:1788874999.194934:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241035904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.194940:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788874999.195242:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241035904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874999.195256:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.195265:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.195312:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.195337:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.195364:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.195434:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036032 00000100:00100000:2.0:1788874999.195438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036032 00000100:00100000:2.0:1788874999.195469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788874999.195476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241036032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.195701:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241036032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.195707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788874999.195821:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.195846:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.195883:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.195910:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.196009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036160 00000100:00100000:0.0:1788874999.196015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036160 00000100:00100000:0.0:1788874999.196197:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788874999.196205:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241036160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.196361:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241036160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.196367:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788874999.196643:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.197461:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8473:1875771241036288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.197517:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.197595:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.207802:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036288 00000100:00100000:1.0:1788874999.207819:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036288 00000100:00100000:1.0:1788874999.207883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788874999.207893:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:8473:x1875771241036288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.208228:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+15:8473:x1875771241036288:12345-0@lo:502:llog_process_th.0 Request processed in 335us (10709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.208235:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788874999.208430:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8473:1875771241036288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.208507:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8473:1875771241036416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.208549:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.208577:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.209121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036416 00000100:00100000:1.0:1788874999.209128:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036416 00000100:00100000:1.0:1788874999.209168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788874999.209177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:8473:x1875771241036416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.209371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+15:8473:x1875771241036416:12345-0@lo:502:llog_process_th.0 Request processed in 196us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.209378:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788874999.209450:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8473:1875771241036416:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788874999.209484:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788874999.209684:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788874999.209704:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788874999.209715:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.209733:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874999.209743:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788874999.209746:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788874999.209749:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788874999.209815:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.209824:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.209833:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874999.209849:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.209881:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.209908:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788874999.209965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036544 00000100:00100000:3.0:1788874999.209970:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036544 00000100:00100000:3.0:1788874999.209993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788874999.209999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+15:5838:x1875771241036544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874999.210009:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874999.210021:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15400/0x60858e6020d82248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82241 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.210053:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15400/0x60858e6020d82248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82241 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.210063:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d82248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82241 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.210071:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15400, rc 0) 00000100:00100000:3.0:1788874999.210106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241036544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874999.210112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788874999.210237:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788874999.210250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.210260:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874999.210305:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.210329:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.210362:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788874999.210415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036672 00000100:00100000:0.0:1788874999.210419:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036672 00000100:00100000:0.0:1788874999.210436:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788874999.210442:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241036672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.210679:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241036672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.210686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788874999.210834:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.210860:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.210900:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.210924:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.210983:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036800 00000100:00100000:1.0:1788874999.210987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036800 00000100:00100000:1.0:1788874999.211007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788874999.211014:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241036800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874999.211174:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241036800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.211182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788874999.211253:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241036800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.211841:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8474:1875771241036928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788874999.211966:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874999.211992:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.212048:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241036928 00000100:00100000:1.0:1788874999.212053:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241036928 00000100:00100000:1.0:1788874999.212086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788874999.212094:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:8474:x1875771241036928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.212247:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:8474:x1875771241036928:12345-0@lo:502:llog_process_th.0 Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.212254:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788874999.212374:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8474:1875771241036928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788874999.212396:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788874999.212404:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874999.212407:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788874999.212411:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788874999.212429:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8474:1875771241037056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788874999.212467:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874999.212484:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a062580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788874999.212568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037056 00000100:00100000:3.0:1788874999.212572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037056 00000100:00100000:3.0:1788874999.212600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788874999.212605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:8474:x1875771241037056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.212717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:8474:x1875771241037056:12345-0@lo:502:llog_process_th.0 Request processed in 111us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874999.212723:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788874999.212844:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8474:1875771241037056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788874999.212861:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788874999.212865:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788874999.212866:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788874999.212870:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788874999.213001:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788874999.213021:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788874999.213039:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.213051:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788874999.213059:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788874999.213062:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a06641800 from 39 10000000:01000000:2.0:1788874999.213064:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788874999.213088:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.213095:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.213103:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788874999.213115:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.213140:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.213165:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788874999.213273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037184 00000100:00100000:3.0:1788874999.213278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037184 00000100:00100000:3.0:1788874999.213307:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788874999.213314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241037184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874999.213322:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788874999.213334:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15800/0x60858e6020d82256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8224f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.213353:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15800/0x60858e6020d82256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8224f expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.213362:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15800/0x60858e6020d82256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8224f expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.213369:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15800, rc 0) 00000100:00100000:3.0:1788874999.213408:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874999.213413:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788874999.213560:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788874999.213572:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788874999.213581:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788874999.213632:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.213657:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874999.213686:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e38000 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.213743:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037312 00000100:00100000:1.0:1788874999.213747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037312 00000100:00100000:1.0:1788874999.213805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788874999.213814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.214198:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.214225:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874999.214354:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.214361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788874999.216575:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788874999.216684:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e38000 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.217312:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037440 00000100:00100000:1.0:1788874999.217323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037440 00000100:00100000:0.0:1788874999.217439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788874999.217449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788874999.217700:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788874999.217708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788874999.218003:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.222426:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8475:1875771241037568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.222529:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.222569:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815600 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.222680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037568 00000100:00100000:1.0:1788874999.222688:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037568 00000100:00100000:1.0:1788874999.222736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788874999.222745:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:8475:x1875771241037568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.223029:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:8475:x1875771241037568:12345-0@lo:502:llog_process_th.0 Request processed in 284us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.223280:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788874999.223424:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8475:1875771241037568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.223488:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8475:1875771241037696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.223523:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.223552:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04815600 going to sleep for 11 seconds 00000100:00100000:3.0:1788874999.223595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037696 00000100:00100000:3.0:1788874999.223601:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037696 00000100:00100000:3.0:1788874999.223634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788874999.223641:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:8475:x1875771241037696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788874999.223822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:8475:x1875771241037696:12345-0@lo:502:llog_process_th.0 Request processed in 180us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788874999.223829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788874999.223978:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8475:1875771241037696:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788874999.223999:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788874999.224165:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788874999.224185:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788874999.224195:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.224206:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788874999.224215:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788874999.224218:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788874999.224221:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788874999.224247:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.224255:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.224264:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.224277:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.224306:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.224338:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.224477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037824 00000100:00100000:1.0:1788874999.224483:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037824 00000100:00100000:1.0:1788874999.224507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788874999.224514:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241037824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874999.224524:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788874999.224538:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8225d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.224559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8225d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.224569:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8225d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.224578:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27600, rc 0) 00000100:00100000:1.0:1788874999.224619:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241037824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.224624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788874999.224743:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788874999.224763:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.224810:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788874999.224859:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.224884:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.224900:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.224955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241037952 00000100:00100000:2.0:1788874999.224959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241037952 00000100:00100000:2.0:1788874999.224978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788874999.224984:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241037952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.225219:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241037952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.225226:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788874999.225336:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.225361:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788874999.225395:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788874999.225416:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.226156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038080 00000100:00100000:1.0:1788874999.226163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038080 00000100:00100000:1.0:1788874999.226189:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788874999.226197:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241038080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788874999.226375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241038080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.226383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788874999.226479:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.227304:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8476:1875771241038208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.227351:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.227388:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.227812:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038208 00000100:00100000:1.0:1788874999.227818:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038208 00000100:00100000:1.0:1788874999.227854:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788874999.227862:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:8476:x1875771241038208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.228331:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:8476:x1875771241038208:12345-0@lo:502:llog_process_th.0 Request processed in 470us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.228338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788874999.228417:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8476:1875771241038208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788874999.228444:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788874999.228462:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874999.228469:0:8476:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788874999.228475:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788874999.228500:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8476:1875771241038336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788874999.228531:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788874999.228562:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788874999.228705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038336 00000100:00100000:1.0:1788874999.228709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038336 00000100:00100000:1.0:1788874999.228741:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788874999.228747:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8476:x1875771241038336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788874999.228906:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8476:x1875771241038336:12345-0@lo:502:llog_process_th.0 Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788874999.228912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788874999.229003:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8476:1875771241038336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788874999.229035:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788874999.229040:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788874999.229042:0:8476:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788874999.229045:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788874999.229269:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788874999.229286:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788874999.229295:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.229307:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788874999.229317:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788874999.229320:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e5a0472b380 from 1 10000000:01000000:1.0:1788874999.229322:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788874999.229348:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.229355:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.229364:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874999.229384:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788874999.229413:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874999.229444:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1964c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.229549:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038464 00000100:00100000:2.0:1788874999.229554:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038464 00000100:00100000:2.0:1788874999.229586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788874999.229593:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241038464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788874999.229603:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788874999.229616:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a19c00/0x60858e6020d82272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8226b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.229640:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a19c00/0x60858e6020d82272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8226b expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.229650:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a19c00/0x60858e6020d82272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8226b expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788874999.229657:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19c00, rc 0) 00000100:00100000:2.0:1788874999.229685:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241038464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788874999.229691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788874999.229887:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788874999.229900:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.229909:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788874999.229958:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788874999.229983:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788874999.230009:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1964c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788874999.230142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038592 00000100:00100000:2.0:1788874999.230154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038592 00000100:00100000:2.0:1788874999.230187:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788874999.230194:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241038592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788874999.230395:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241038592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (410us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788874999.230402:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788874999.230557:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241038592:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788874999.230584:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788874999.230590:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788874999.230598:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788874999.568594:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875000.606133:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875000.988618:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875000.988810:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941248 00000100:00100000:1.0:1788875000.988820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941248 00000100:00100000:1.0:1788875000.988880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:1.0:1788875000.988891:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+8:5593:x1875771217941248:12345-192.168.202.7@tcp:101: 00010000:00010000:1.0:1788875000.988926:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875000.988945:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a64 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875000.988975:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a64 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875000.988987:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a64 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875000.988997:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26a00, rc 0) 00000100:00100000:1.0:1788875000.989677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941248:12345-192.168.202.7@tcp:101: Request processed in 785us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875000.989684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:0.0:1788875001.000024:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875001.002381:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941376 00000100:00100000:2.0:1788875001.002399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941376 00000100:00100000:2.0:1788875001.002486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:2.0:1788875001.002498:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941376:12345-192.168.202.7@tcp:501: 00000100:00100000:2.0:1788875001.002894:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941376:12345-192.168.202.7@tcp:501: Request processed in 397us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875001.002902:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:3.0:1788875001.006888:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875001.012219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941504 00000100:00100000:1.0:1788875001.012239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941504 00000100:00100000:1.0:1788875001.012316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:1.0:1788875001.012326:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941504:12345-192.168.202.7@tcp:503: 00000100:00100000:1.0:1788875001.012581:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941504:12345-192.168.202.7@tcp:503: Request processed in 255us (5707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875001.012590:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:3.0:1788875001.017560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875001.021109:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941632 00000100:00100000:2.0:1788875001.021128:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941632 00000100:00100000:2.0:1788875001.021214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:2.0:1788875001.021225:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+9:6079:x1875771217941632:12345-192.168.202.7@tcp:502: 00000100:00100000:2.0:1788875001.021542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+9:6079:x1875771217941632:12345-192.168.202.7@tcp:502: Request processed in 317us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875001.021551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:0.0:1788875001.029185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875001.029303:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941760 00000100:00100000:3.0:1788875001.029315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941760 00000100:00100000:3.0:1788875001.029401:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:3.0:1788875001.029413:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+9:6079:x1875771217941760:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788875001.030090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+9:6079:x1875771217941760:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 673us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875001.030101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:3.0:1788875001.046148:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875001.046297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217941888 00000100:00100000:1.0:1788875001.046314:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217941888 00000100:00100000:1.0:1788875001.046391:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:1.0:1788875001.046404:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217941888:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875001.046428:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875001.046459:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26400/0x60858e6020d82280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a6b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875001.046516:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26400/0x60858e6020d82280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a6b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875001.046530:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b26400/0x60858e6020d82280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a6b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875001.046542:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26400, rc 0) 00000100:00100000:1.0:1788875001.046635:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217941888:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 232us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875001.046644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:0.0:1788875001.051034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875001.061644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942016 00000100:00100000:2.0:1788875001.061672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942016 00000100:00100000:2.0:1788875001.062672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:2.0:1788875001.062696:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217942016:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875001.063115:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217942016:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 428us (12095us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788875001.063133:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 172 00010000:00010000:3.0:1788875001.616950:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875002.643986:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875002.653023:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875002.653071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875002.653099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875002.653125:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875002.653165:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942272 00000100:00100000:3.0:1788875002.653175:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942272 00000100:00100000:3.0:1788875002.653235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:3.0:1788875002.653246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217942272:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875002.653315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217942272:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875002.653322:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:3.0:1788875002.653361:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942528 00000100:00100000:3.0:1788875002.653365:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942528 00000100:00100000:3.0:1788875002.653390:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942400 00000100:00100000:3.0:1788875002.653393:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942400 00000100:00100000:3.0:1788875002.653413:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875002.653420:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217942528:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875002.653447:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217942528:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875002.653454:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875002.653466:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1788875002.653472:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217942400:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875002.653496:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217942400:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875002.653519:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00080000:3.0:1788875002.653539:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788875002.653543:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875002.653546:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875002.655289:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942144 00000100:00100000:1.0:1788875002.655302:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942144 00000100:00100000:1.0:1788875002.655369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:1.0:1788875002.655378:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217942144:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875002.655437:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771217942144:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 60us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875002.655444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 173 00000020:00000080:0.0:1788875003.106885:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9c0d9010 20000000:00000080:0.0:1788875003.106911:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a3c523400 uarg=0000000000000000 20000000:01000000:0.0:1788875003.106964:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788875003.106973:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788875003.106980:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788875003.112495:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788875003.113040:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788875003.120753:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788875003.120971:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788875003.121032:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788875003.121051:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788875003.121070:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121089:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121097:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82057 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121104:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82122 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121114:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121122:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121178:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121194:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 9 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875003.121225:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038720:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875003.121970:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.121980:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875003.121992:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038848:0@lo:104: 00000100:00100000:2.0:1788875003.122035:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788875003.122080:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875003.122088:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875003.122097:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038976:0@lo:104: 00000100:00100000:2.0:1788875003.122124:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788875003.122152:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875003.122263:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788875003.122277:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038848 00000100:00100000:0.0:1788875003.122285:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038848 00000100:00100000:0.0:1788875003.122321:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241038976 00000100:00100000:0.0:1788875003.122334:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241038976 00000100:00100000:0.0:1788875003.122353:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788875003.122362:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:8515:x1875771241038848:12345-0@lo:104: 00010000:00010000:0.0:1788875003.122375:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875003.122439:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788875003.122446:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:8515:x1875771241038848:12345-0@lo:104: Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875003.122454:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788875003.122471:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788875003.122478:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:8515:x1875771241038976:12345-0@lo:104: 00010000:00010000:0.0:1788875003.122485:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875003.122517:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788875003.122521:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:8515:x1875771241038976:12345-0@lo:104: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875003.122538:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788875003.122810:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875003.122820:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241039104:0@lo:104: 00000100:00100000:2.0:1788875003.122845:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875003.122864:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f91b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788875003.122883:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038848:0@lo:104: 00000100:00100000:2.0:1788875003.122891:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038976:0@lo:104: 00000100:00100000:1.0:1788875003.122971:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039104 00000100:00100000:1.0:1788875003.122976:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039104 00000100:00100000:1.0:1788875003.122999:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788875003.123005:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:8515:x1875771241039104:12345-0@lo:104: 00010000:00010000:1.0:1788875003.123014:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123065:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788875003.123069:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:8515:x1875771241039104:12345-0@lo:104: Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.123081:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788875003.123099:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788875003.123105:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123111:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788875003.123115:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123124:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788875003.123131:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875003.123137:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788875003.123179:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123187:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788875003.123206:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123213:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb800/0x60858e6020d82122 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82129 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123237:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875003.123240:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123256:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027ea200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788875003.123259:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123266:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788875003.123273:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875003.123278:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788875003.123296:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123300:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788875003.123306:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123311:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027ea200/0x60858e6020d82057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8205e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123321:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875003.123323:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123328:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eb000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788875003.123331:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123347:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788875003.123354:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875003.123358:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788875003.123372:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123377:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788875003.123392:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123397:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eb000/0x60858e6020d81ff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d81ffc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123410:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875003.123412:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875003.123414:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875003.123654:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875003.123690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.123720:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875003.123728:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875003.123761:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.123807:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241039488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875003.123830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.123862:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039232 00000100:00100000:1.0:1788875003.123875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039232 00010000:00010000:1.0:1788875003.123896:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 19 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875003.123917:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039360 00000100:00100000:1.0:1788875003.123920:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039360 00010000:00010000:1.0:1788875003.123930:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 20 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875003.123938:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039488 00000100:00100000:1.0:1788875003.123941:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039488 00010000:00010000:1.0:1788875003.123948:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 21 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875003.123959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788875003.123964:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+21:3303:x1875771241039232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875003.123974:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875003.123980:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 21 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.123989:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 21 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124004:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26800/0x60858e6020d82129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82122 expref: 21 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124023:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875003.124059:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+20:3303:x1875771241039232:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.124067:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788875003.124082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788875003.124096:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241039360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875003.124105:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875003.124109:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 19 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124116:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 19 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124125:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027ebe00/0x60858e6020d8205e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d82057 expref: 19 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124133:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875003.124166:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+18:3303:x1875771241039360:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.124172:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788875003.124186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788875003.124192:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+17:3305:x1875771241039488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875003.124200:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875003.124204:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 17 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124211:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 17 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.124219:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875003.124361:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+17:3305:x1875771241039488:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.124368:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788875003.124406:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241039488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875003.124515:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875003.124594:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875003.124762:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27e00/0x60858e6020d81ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d81ff5 expref: 16 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875003.124812:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241039104:0@lo:104: 00010000:00010000:0.0:1788875003.124880:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875003.124886:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875003.128109:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1875771241038720:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875003.128146:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875003.130472:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875003.130652:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942656 00000100:00100000:1.0:1788875003.130662:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942656 00010000:00010000:1.0:1788875003.130700:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875003.130755:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:1.0:1788875003.130766:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217942656:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875003.130805:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875003.130812:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130826:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130845:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26200/0x60858e6020d821e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a33 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130865:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130874:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130891:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130898:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130916:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130923:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130930:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875003.130934:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130943:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130962:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875003.130973:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875003.131025:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+9:2348:x1875771217942656:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 260us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.131033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00010000:00010000:0.0:1788875003.131565:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875003.131575:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875003.131582:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18600/0x60858e6020d82287 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875003.226894:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875003.226919:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241039616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875003.226989:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.227049:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039616 00000100:00100000:1.0:1788875003.227056:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039616 00000100:00100000:1.0:1788875003.227109:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788875003.227118:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241039616:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875003.227137:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788875003.227155:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875003.228598:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241039616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1472us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875003.228611:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788875003.228841:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58c000 x1875771241039616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875003.228865:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241039616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788875003.661993:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875003.726145:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241040128:0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.726218:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875003.726277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875003.726284:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241040000:0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.726306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875003.726334:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040128 00000100:00100000:2.0:1788875003.726341:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040128 00000100:00100000:2.0:1788875003.726386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040000 00000100:00100000:2.0:1788875003.726388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040000 00000100:00100000:2.0:1788875003.726408:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788875003.726415:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.726462:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241040128:12345-0@lo:400:kworker.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875003.726470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788875003.726484:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788875003.726490:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241040000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.726514:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241040000:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875003.726535:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788875003.726569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241040000:0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.726579:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241040128:0@lo:400:kworker.0 00000100:00100000:1.0:1788875003.726799:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039744:0@lo:400:kworker.0 00000100:00100000:1.0:1788875003.726838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.726860:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241040256:0@lo:400:kworker.0 00000100:00100000:1.0:1788875003.726884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.726902:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875003.726908:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241039872:0@lo:400:kworker.0 00000100:00100000:1.0:1788875003.726929:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875003.726954:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039872 00000100:00100000:1.0:1788875003.726958:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039872 00000100:00100000:1.0:1788875003.726993:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788875003.726999:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241039872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875003.727036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241039872:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875003.727042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788875003.727069:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241039872:0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.727186:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241039744 00000100:00100000:2.0:1788875003.727190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241039744 00000100:00100000:2.0:1788875003.727220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788875003.727226:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875003.727260:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241039744:12345-0@lo:400:kworker.0 Request processed in 35us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875003.727265:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788875003.727436:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040256 00000100:00100000:3.0:1788875003.727440:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040256 00000100:00100000:3.0:1788875003.727476:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788875003.727482:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241040256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875003.727517:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241040256:12345-0@lo:400:kworker.0 Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875003.727523:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788875003.727712:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241039744:0@lo:400:kworker.0 00010000:00080000:1.0:1788875003.727726:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3f7f8380 x1875771241040256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875003.727747:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241040256:0@lo:400:kworker.0 00000100:00080000:0.0:1788875003.727931:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875003.727937:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875004.240334:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875004.240371:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241040384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875004.240476:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.240597:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040384 00000100:00100000:2.0:1788875004.240607:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040384 00000100:00100000:2.0:1788875004.240669:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788875004.240681:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241040384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875004.240740:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875004.240825:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241040384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.240833:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788875004.240904:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58c000 x1875771241040384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875004.240929:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241040384:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788875004.557933:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788875004.557942:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5904e88000 from 4 10000000:01000000:1.0:1788875004.557949:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788875004.557999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.558012:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.558037:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875004.558064:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788875004.558137:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875004.558201:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06b94300 going to sleep for 11 seconds 00000100:00100000:3.0:1788875004.558911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040512 00000100:00100000:3.0:1788875004.558920:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040512 00000100:00100000:3.0:1788875004.558975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788875004.558984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241040512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788875004.558997:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875004.559010:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8228e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875004.559032:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875004.559042:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875004.559058:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:3.0:1788875004.559112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241040512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875004.559119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788875004.559384:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875004.559413:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.559423:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875004.559479:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875004.559519:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875004.559544:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06b94300 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.560357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040640 00000100:00100000:2.0:1788875004.560364:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040640 00000100:00100000:2.0:1788875004.560414:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788875004.560423:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241040640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.560701:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241040640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.560708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788875004.561039:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875004.561083:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875004.561124:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875004.561163:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0855d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875004.562015:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040768 00000100:00100000:1.0:1788875004.562022:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040768 00000100:00100000:1.0:1788875004.562053:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788875004.562060:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241040768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875004.562241:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241040768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875004.562258:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788875004.562302:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241040768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875004.562510:0:8547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8547:1875771241040896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875004.562552:0:8547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875004.562585:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241040896 00000100:00100000:1.0:1788875004.562588:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241040896 00000100:00100000:1.0:1788875004.562605:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788875004.562610:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:8547:x1875771241040896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875004.562739:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:8547:x1875771241040896:12345-0@lo:502:llog_process_th.0 Request processed in 128us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875004.562745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788875004.562803:0:8547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a373c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788875004.562814:0:8547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8547:1875771241040896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788875004.562834:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788875004.562843:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875004.562846:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788875004.562852:0:8547:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5904e88000 00000020:00000080:1.0:1788875004.562854:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788875004.564236:0:8547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8547:1875771241041024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.564587:0:8547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.564632:0:8547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f91600 going to sleep for 11 seconds 00000100:00100000:3.0:1788875004.565729:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041024 00000100:00100000:3.0:1788875004.565739:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041024 00000100:00100000:3.0:1788875004.565822:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788875004.565834:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:8547:x1875771241041024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.566233:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:8547:x1875771241041024:12345-0@lo:502:llog_process_th.0 Request processed in 401us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.566242:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788875004.566300:0:8547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8547:1875771241041024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788875004.566328:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788875004.566335:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875004.566337:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788875004.566341:0:8547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788875004.566642:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788875004.566660:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788875004.566671:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.566681:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875004.566692:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788875004.566694:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a07881000 from 4 10000000:01000000:1.0:1788875004.566697:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788875004.566738:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.566758:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875004.566767:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875004.566818:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788875004.566854:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875004.566889:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a032420c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.566890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041152 00000100:00100000:2.0:1788875004.566895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041152 00000100:00100000:2.0:1788875004.566932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788875004.566940:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241041152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875004.566950:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875004.566963:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8229c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.566985:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8229c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.567002:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8229c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.567010:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875004.567043:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.567049:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788875004.567079:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875004.567090:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.567099:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875004.567139:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.567163:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.567175:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f91900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.567186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041280 00000100:00100000:2.0:1788875004.567190:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041280 00000100:00100000:2.0:1788875004.567208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788875004.567228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.567437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.567444:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788875004.567473:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.567518:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.567549:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.567579:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0626c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.567589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041408 00000100:00100000:2.0:1788875004.567592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041408 00000100:00100000:2.0:1788875004.567610:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788875004.567615:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.567943:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.567950:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788875004.567986:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.568146:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8549:1875771241041536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.568176:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.568192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041536 00000100:00100000:2.0:1788875004.568195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041536 00000100:00100000:2.0:1788875004.568215:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788875004.568221:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8549:x1875771241041536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.568339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8549:x1875771241041536:12345-0@lo:502:llog_process_th.0 Request processed in 117us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.568345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788875004.568373:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a24434b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.568385:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8549:1875771241041536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788875004.568403:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788875004.568412:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875004.568418:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788875004.568425:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a07881000 00000020:00000080:2.0:1788875004.568428:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788875004.568488:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8549:1875771241041664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.568520:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.568537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041664 00000100:00100000:2.0:1788875004.568540:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041664 00000100:00100000:2.0:1788875004.568559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788875004.568581:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8549:x1875771241041664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.568682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:8549:x1875771241041664:12345-0@lo:502:llog_process_th.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.568689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788875004.568715:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a24434b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.568739:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8549:1875771241041664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788875004.568756:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788875004.568759:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875004.568761:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788875004.568764:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788875004.568820:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788875004.568835:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875004.568844:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.568854:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875004.568863:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788875004.568866:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06641800 from 4 10000000:01000000:2.0:1788875004.568868:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788875004.568894:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.568902:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.568911:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875004.568923:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.568946:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.568956:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22000 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.568967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041792 00000100:00100000:2.0:1788875004.568970:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041792 00000100:00100000:2.0:1788875004.568990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788875004.568996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241041792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875004.569004:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875004.569015:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d822aa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.569033:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d822aa expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.569043:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d822aa expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.569052:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875004.569078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241041792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.569084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788875004.569117:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875004.569128:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.569136:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875004.569171:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569192:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.569203:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22000 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.569213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241041920 00000100:00100000:2.0:1788875004.569217:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241041920 00000100:00100000:2.0:1788875004.569234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788875004.569239:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241041920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241041920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.569412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788875004.569439:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241041920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569461:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241042048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569491:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.569504:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22000 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.569514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042048 00000100:00100000:2.0:1788875004.569518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042048 00000100:00100000:2.0:1788875004.569536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788875004.569542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241042048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569641:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241042048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.569652:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788875004.569685:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241042048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875004.569923:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8550:1875771241042176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.569952:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.569969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042176 00000100:00100000:2.0:1788875004.569972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042176 00000100:00100000:2.0:1788875004.569992:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788875004.569997:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:8550:x1875771241042176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.570098:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:8550:x1875771241042176:12345-0@lo:502:llog_process_th.0 Request processed in 100us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.570104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788875004.570129:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.570139:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8550:1875771241042176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788875004.570156:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788875004.570163:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875004.570165:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788875004.570171:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a06641800 00000020:00000080:2.0:1788875004.570174:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788875004.570228:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8550:1875771241042304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.570258:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875004.570275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042304 00000100:00100000:2.0:1788875004.570278:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042304 00000100:00100000:2.0:1788875004.570297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788875004.570303:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:8550:x1875771241042304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875004.570398:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:8550:x1875771241042304:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875004.570410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788875004.570437:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875004.570447:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:8550:1875771241042304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788875004.570462:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788875004.570466:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875004.570467:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788875004.570471:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788875004.570510:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788875004.570524:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875004.570533:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.570541:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875004.692408:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875005.023658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875005.023696:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942784 00000100:00100000:2.0:1788875005.023705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942784 00000100:00100000:2.0:1788875005.023763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:2.0:1788875005.023787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+9:5593:x1875771217942784:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875005.023805:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875005.023825:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a72 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875005.023855:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875005.023880:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875005.023890:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19800, rc 0) 00000100:00100000:2.0:1788875005.023947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217942784:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875005.023954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:1.0:1788875005.036592:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875005.036629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217942912 00000100:00100000:1.0:1788875005.036638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217942912 00000100:00100000:1.0:1788875005.036688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:1.0:1788875005.036699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217942912:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875005.036982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217942912:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 284us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875005.036990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:2.0:1788875005.071261:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875005.071296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943040 00000100:00100000:2.0:1788875005.071306:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943040 00000100:00100000:2.0:1788875005.071351:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 192 00000100:00100000:2.0:1788875005.071361:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217943040:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875005.071586:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:5593:x1875771217943040:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 227us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875005.071594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 192 00000100:00100000:0.0:1788875005.079222:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875005.080754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943168 00000100:00100000:3.0:1788875005.080767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943168 00000100:00100000:3.0:1788875005.080840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 193 00000100:00100000:3.0:1788875005.080851:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:6142:x1875771217943168:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788875005.081075:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:6142:x1875771217943168:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 226us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875005.081084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 193 00000100:00100000:1.0:1788875005.091056:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875005.091295:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943296 00000100:00100000:0.0:1788875005.091306:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943296 00000100:00100000:0.0:1788875005.091350:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:0.0:1788875005.091359:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:6142:x1875771217943296:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788875005.091615:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:6142:x1875771217943296:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 255us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875005.091624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 194 00010000:00010000:3.0:1788875005.710099:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875006.734440:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875007.758355:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875007.778807:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875007.778855:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875007.778891:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875007.778932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875007.778965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943552 00000100:00100000:3.0:1788875007.778974:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943552 00000100:00100000:3.0:1788875007.779043:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1788875007.779054:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217943552:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875007.779134:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217943552:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875007.779150:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1788875007.779176:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943680 00000100:00100000:3.0:1788875007.779179:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943680 00000100:00100000:3.0:1788875007.779203:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943808 00000100:00100000:3.0:1788875007.779205:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943808 00000100:00100000:3.0:1788875007.779226:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875007.779232:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217943680:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875007.779260:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217943680:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875007.779266:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875007.779290:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1788875007.779297:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217943808:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875007.779322:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217943808:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875007.779328:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00080000:3.0:1788875007.779344:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875007.779348:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788875007.779351:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875007.779803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943424 00000100:00100000:2.0:1788875007.779809:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943424 00000100:00100000:2.0:1788875007.779846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:2.0:1788875007.779854:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217943424:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875007.779897:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217943424:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 44us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875007.779903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:0.0:1788875008.334557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875008.334630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875008.334844:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042432 00000100:00100000:1.0:1788875008.334853:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042432 00000100:00100000:1.0:1788875008.335162:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788875008.335172:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241042432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875008.335203:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875008.335253:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875008.335260:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788875008.335323:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02d180 x1875771241042432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875008.335341:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241042432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875008.337423:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788875008.786208:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875008.846067:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241042944:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875008.846206:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788875008.846213:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241042560:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875008.846262:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241043072:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875008.846310:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241042688:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875008.846350:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875008.846356:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241042816:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846375:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875008.846407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042944 00000100:00100000:2.0:1788875008.846416:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042944 00000100:00100000:2.0:1788875008.846468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042688 00000100:00100000:2.0:1788875008.846471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042688 00000100:00100000:2.0:1788875008.846482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042816 00000100:00100000:2.0:1788875008.846484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042816 00000100:00100000:2.0:1788875008.846497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788875008.846504:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241042944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846551:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241042944:12345-0@lo:400:kworker.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875008.846558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788875008.846572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788875008.846577:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241042688:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875008.846606:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788875008.846623:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788875008.846628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241042816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846651:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241042816:12345-0@lo:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875008.846656:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788875008.846670:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043072 00000100:00100000:2.0:1788875008.846674:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043072 00000100:00100000:2.0:1788875008.846713:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788875008.846720:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846751:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241043072:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875008.846757:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788875008.846828:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241042816:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846839:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241042688:0@lo:400:kworker.0 00010000:00080000:2.0:1788875008.846869:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3f7fbb80 x1875771241043072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875008.846880:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241043072:0@lo:400:kworker.0 00000100:00100000:2.0:1788875008.846890:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241042944:0@lo:400:kworker.0 00000100:00100000:0.0:1788875008.846971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241042560 00000100:00100000:0.0:1788875008.846976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241042560 00000100:00100000:0.0:1788875008.847009:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788875008.847022:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241042560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875008.847061:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241042560:12345-0@lo:400:kworker.0 Request processed in 41us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875008.847068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1788875008.847107:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875008.847111:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875008.847125:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241042560:0@lo:400:kworker.0 00000100:00100000:3.0:1788875009.364961:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875009.364982:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241043200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875009.365051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875009.365108:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043200 00000100:00100000:3.0:1788875009.365116:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043200 00000100:00100000:3.0:1788875009.365160:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788875009.365168:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241043200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875009.365211:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875009.365256:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241043200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875009.365264:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788875009.365305:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58d500 x1875771241043200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875009.365323:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241043200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875009.812040:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875009.955859:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788875010.829958:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875011.854035:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875012.878037:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875012.911500:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875012.911557:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875012.911901:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944064 00000100:00100000:2.0:1788875012.911911:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944064 00000100:00100000:2.0:1788875012.911995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1788875012.912005:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217944064:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875012.912079:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217944064:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 75us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875012.912103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00080000:1.0:1788875012.912493:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875012.912721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217943936 00000100:00100000:0.0:1788875012.912726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217943936 00000100:00100000:0.0:1788875012.912809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:0.0:1788875012.912820:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217943936:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875012.912863:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217943936:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 47us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875012.912870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:3.0:1788875012.915853:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875012.915900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875012.916095:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944192 00000100:00100000:1.0:1788875012.916105:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944192 00000100:00100000:1.0:1788875012.916180:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944320 00000100:00100000:1.0:1788875012.916184:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944320 00000100:00100000:1.0:1788875012.916210:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1788875012.916219:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2346:x1875771217944192:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:1.0:1788875012.916253:0:6901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821f4 00000100:00080000:1.0:1788875012.916262:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5a36169000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788875012.916301:0:6901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788875012.916676:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+2:2346:x1875771217944192:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 457us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875012.916684:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1788875012.916705:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1788875012.916712:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2346:x1875771217944320:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:1.0:1788875012.916726:0:6901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821fb 00000100:00080000:1.0:1788875012.916732:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5906b04000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788875012.916754:0:6901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788875012.916962:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+2:2346:x1875771217944320:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 249us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875012.916969:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00010000:00010000:1.0:1788875012.916996:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875012.917002:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788875012.919640:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875012.919659:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875013.453995:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788875013.454020:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875013.454088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875013.454264:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043328 00000100:00100000:1.0:1788875013.454280:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043328 00000100:00100000:1.0:1788875013.454354:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788875013.454364:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241043328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875013.454400:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875013.454448:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241043328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875013.454455:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788875013.454575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788875013.454616:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02d180 x1875771241043328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875013.454634:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241043328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788875013.904985:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875013.966271:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241043584:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966341:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875013.966403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788875013.966409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241043456:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875013.966455:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875013.966497:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241043840:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966515:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875013.966530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788875013.966534:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241043712:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875013.966573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043456 00000100:00100000:2.0:1788875013.966580:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043456 00000100:00100000:2.0:1788875013.966631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788875013.966649:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241043456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966697:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241043456:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875013.966705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788875013.966739:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043968 00000100:00100000:2.0:1788875013.966743:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043968 00000100:00100000:2.0:1788875013.966805:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788875013.966813:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966843:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241043968:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875013.966860:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788875013.966879:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043584 00000100:00100000:2.0:1788875013.966883:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043584 00000100:00100000:2.0:1788875013.966907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043840 00000100:00100000:2.0:1788875013.966910:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043840 00000100:00100000:2.0:1788875013.966923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241043712 00000100:00100000:2.0:1788875013.966925:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241043712 00000100:00100000:2.0:1788875013.966938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788875013.966944:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.966974:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241043584:12345-0@lo:400:kworker.0 Request processed in 30us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875013.966980:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788875013.966990:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788875013.966996:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.967026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241043840:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875013.967033:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788875013.967044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788875013.967049:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.967075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241043712:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875013.967080:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788875013.967120:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241043456:0@lo:400:kworker.0 00010000:00080000:2.0:1788875013.967151:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02f800 x1875771241043968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875013.967162:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.967183:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241043584:0@lo:400:kworker.0 00000100:00080000:2.0:1788875013.967208:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788875013.967212:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875013.967233:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241043712:0@lo:400:kworker.0 00000100:00100000:2.0:1788875013.967242:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241043840:0@lo:400:kworker.0 00000100:00100000:0.0:1788875014.480276:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788875014.480301:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241044096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875014.480384:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875014.480560:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044096 00000100:00100000:1.0:1788875014.480571:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044096 00000100:00100000:1.0:1788875014.480645:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788875014.480656:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241044096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875014.480695:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875014.480753:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241044096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875014.480760:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788875014.480822:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37e680 x1875771241044096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875014.480840:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241044096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875014.926023:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875015.952500:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788875016.577413:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing yml_node 00010000:00010000:1.0:1788875016.978270:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788875017.103231:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:1.0:1788875017.103240:0:7652:0:(genops.c:885:class_export_put()) final put ffff9e5906b03800/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:1.0:1788875017.103266:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5906b03800/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-OST0001 00000020:00000080:1.0:1788875017.103310:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5906b04000 for lustre-OST0001 00000001:00100000:2.0:1788875017.613620:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:2.0:1788875017.613630:0:6720:0:(genops.c:885:class_export_put()) final put ffff9e5a3546b000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:2.0:1788875017.613656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3546b000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-OST0000 00000020:00000080:2.0:1788875017.613700:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a36169000 for lustre-OST0000 00010000:00010000:1.0:1788875017.997930:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875018.017422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875018.017473:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875018.017540:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944448 00000100:00100000:1.0:1788875018.017557:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944448 00000100:00100000:1.0:1788875018.017641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 199 00000100:00100000:1.0:1788875018.017653:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217944448:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875018.017806:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217944448:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875018.017816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 199 00000100:00100000:3.0:1788875018.018168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944576 00000100:00100000:3.0:1788875018.018179:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944576 00000100:00100000:3.0:1788875018.018290:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1788875018.018302:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217944576:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875018.018375:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217944576:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 77us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875018.018719:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00080000:1.0:1788875018.018724:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875018.576499:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241044224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875018.576617:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875018.577021:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044224 00000100:00100000:3.0:1788875018.577043:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044224 00000100:00100000:3.0:1788875018.577141:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788875018.577153:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241044224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875018.577202:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875018.577280:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241044224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875018.577289:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788875018.577631:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788875018.577683:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02d880 x1875771241044224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875018.577711:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241044224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788875019.022084:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875019.086348:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241044480:0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.086464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875019.086555:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875019.086563:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241044608:0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.086598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875019.086646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044480 00000100:00100000:3.0:1788875019.086673:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044480 00000100:00100000:3.0:1788875019.086728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044608 00000100:00100000:3.0:1788875019.086731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044608 00000100:00100000:3.0:1788875019.086768:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788875019.086812:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.086875:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241044480:12345-0@lo:400:kworker.0 Request processed in 65us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875019.086883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788875019.086906:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788875019.086912:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241044608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.086940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241044608:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875019.086946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788875019.086994:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241044608:0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.087023:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241044480:0@lo:400:kworker.0 00000100:00080000:0.0:1788875019.087284:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875019.087300:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241044352:0@lo:400:kworker.0 00000100:00100000:0.0:1788875019.087345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875019.087397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241044864:0@lo:400:kworker.0 00000100:00100000:0.0:1788875019.087424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875019.087445:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788875019.087451:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241044736:0@lo:400:kworker.0 00000100:00100000:0.0:1788875019.087476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875019.087668:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044352 00000100:00100000:3.0:1788875019.087674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044352 00000100:00100000:3.0:1788875019.087719:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788875019.087727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.087769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241044352:12345-0@lo:400:kworker.0 Request processed in 42us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875019.087801:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788875019.087837:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044736 00000100:00100000:3.0:1788875019.087841:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044736 00000100:00100000:3.0:1788875019.087872:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788875019.087878:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.087908:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241044736:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875019.087914:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788875019.088352:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044864 00000100:00100000:1.0:1788875019.088359:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044864 00000100:00100000:1.0:1788875019.088415:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788875019.088425:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875019.088470:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241044864:12345-0@lo:400:kworker.0 Request processed in 47us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875019.088477:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788875019.088669:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875019.088675:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875019.088710:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241044736:0@lo:400:kworker.0 00000100:00100000:0.0:1788875019.088722:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241044352:0@lo:400:kworker.0 00010000:00080000:0.0:1788875019.088736:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d27a300 x1875771241044864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875019.088768:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241044864:0@lo:400:kworker.0 00000100:00100000:3.0:1788875019.598119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875019.598200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875019.598487:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241044992 00000100:00100000:2.0:1788875019.598504:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241044992 00000100:00100000:2.0:1788875019.598610:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788875019.598623:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241044992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875019.598688:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875019.598812:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241044992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875019.598820:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788875019.598930:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37f800 x1875771241044992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875019.598956:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241044992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788875020.045967:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788875020.890681:0:9253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788875021.072278:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875022.096088:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875023.128893:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875023.153013:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875023.153074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875023.153268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944704 00000100:00100000:0.0:1788875023.153283:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944704 00000100:00100000:0.0:1788875023.153356:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:0.0:1788875023.153370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217944704:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875023.153476:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217944704:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 109us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875023.153486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:3.0:1788875023.153842:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944832 00000100:00100000:3.0:1788875023.153849:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944832 00000100:00100000:3.0:1788875023.153913:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:3.0:1788875023.153930:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217944832:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875023.153974:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217944832:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 47us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875023.154002:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00080000:0.0:1788875023.154196:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875023.706042:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875023.706074:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875023.706175:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875023.706267:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045120 00000100:00100000:1.0:1788875023.706278:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045120 00000100:00100000:1.0:1788875023.706356:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788875023.706368:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241045120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875023.706418:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875023.706475:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241045120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875023.706483:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788875023.706509:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788875023.706767:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d02ed80 x1875771241045120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875023.707095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241045120:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788875023.723213:0:9351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:1.0:1788875024.142201:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875024.209000:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209153:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241045888:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209208:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788875024.209213:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241045248:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209273:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241045760:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209293:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209317:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875024.209362:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241045504:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875024.209412:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045888 00000100:00100000:2.0:1788875024.209432:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045888 00000100:00100000:2.0:1788875024.209486:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045632 00000100:00100000:2.0:1788875024.209489:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045632 00000100:00100000:2.0:1788875024.209510:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788875024.209519:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241045888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209581:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241045888:12345-0@lo:400:kworker.0 Request processed in 63us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209588:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788875024.209604:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875024.209611:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209640:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241045632:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209645:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875024.209671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045248 00000100:00100000:2.0:1788875024.209675:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045248 00000100:00100000:2.0:1788875024.209699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788875024.209705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241045248:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209742:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788875024.209766:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045376 00000100:00100000:2.0:1788875024.209796:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045376 00000100:00100000:2.0:1788875024.209822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045760 00000100:00100000:2.0:1788875024.209825:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045760 00000100:00100000:2.0:1788875024.209838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241045504 00000100:00100000:2.0:1788875024.209839:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241045504 00000100:00100000:2.0:1788875024.209851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788875024.209856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209885:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241045376:12345-0@lo:400:kworker.0 Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788875024.209901:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788875024.209906:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241045760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209930:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241045760:12345-0@lo:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788875024.209947:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788875024.209952:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.209977:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241045504:12345-0@lo:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875024.209993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788875024.210016:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788875024.210020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875024.210058:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241045504:0@lo:400:kworker.0 00010000:00080000:2.0:1788875024.210070:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37f480 x1875771241045632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875024.210079:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.210106:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241045248:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.210115:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241045760:0@lo:400:kworker.0 00000100:00100000:2.0:1788875024.210122:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241045376:0@lo:400:kworker.0 00010000:00080000:2.0:1788875024.210130:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37f800 x1875771241045888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875024.210138:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241045888:0@lo:400:kworker.0 00000100:00100000:1.0:1788875024.721895:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241046016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875024.721969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875024.722871:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046016 00000100:00100000:0.0:1788875024.722882:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046016 00000100:00100000:0.0:1788875024.722943:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788875024.722954:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241046016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875024.722999:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875024.723056:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241046016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875024.723063:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788875024.723374:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d279880 x1875771241046016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875024.723395:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241046016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788875025.166012:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875026.191170:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875026.578335:0:9449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1788875027.215193:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788875028.118653:0:9497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 09:43:47 EDT 2026 00010000:00010000:1.0:1788875028.238959:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875028.263981:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875028.264045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875028.264166:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217944960 00000100:00100000:3.0:1788875028.264180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217944960 00000100:00100000:3.0:1788875028.264262:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00100000:3.0:1788875028.264273:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217944960:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875028.264353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945088 00000100:00100000:0.0:1788875028.264362:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945088 00000100:00100000:3.0:1788875028.264371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217944960:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875028.264381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00100000:0.0:1788875028.264421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1788875028.264432:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217945088:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:2.0:1788875028.264589:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875028.264616:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217945088:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 185us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875028.264642:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1788875028.818004:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875028.818037:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241046144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875028.818137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875028.818219:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046144 00000100:00100000:3.0:1788875028.818228:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046144 00000100:00100000:3.0:1788875028.818299:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788875028.818309:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241046144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875028.818356:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875028.818455:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241046144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875028.818463:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788875028.818486:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788875028.818535:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a34ee3b80 x1875771241046144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875028.818558:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241046144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788875029.261950:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875029.326704:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.326822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875029.326919:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788875029.326926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241046528:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.326955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875029.326999:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046656 00000100:00100000:0.0:1788875029.327010:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046656 00000100:00100000:1.0:1788875029.327041:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241046272:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.327079:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788875029.327092:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875029.327129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875029.327182:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241046656:12345-0@lo:400:kworker.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875029.327192:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.327195:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788875029.327234:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046528 00000100:00100000:1.0:1788875029.327242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875029.327242:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046528 00000100:00100000:1.0:1788875029.327285:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788875029.327295:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241046400:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.327310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046784 00000100:00100000:0.0:1788875029.327315:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046784 00000100:00100000:1.0:1788875029.327327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875029.327359:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241046912:0@lo:400:kworker.0 00000100:00100000:1.0:1788875029.327386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875029.327432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046272 00000100:00100000:2.0:1788875029.327439:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046272 00000100:00100000:2.0:1788875029.327483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788875029.327502:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241046272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875029.327555:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046912 00000100:00100000:2.0:1788875029.327564:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241046272:12345-0@lo:400:kworker.0 Request processed in 65us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875029.327578:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046912 00000100:00100000:2.0:1788875029.327593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788875029.327665:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788875029.327672:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241046272:0@lo:400:kworker.0 00000100:00100000:3.0:1788875029.327681:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875029.327810:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241046912:12345-0@lo:400:kworker.0 Request processed in 135us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875029.327818:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788875029.327987:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37d500 x1875771241046912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875029.328003:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.331460:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241046400 00000100:00100000:0.0:1788875029.331501:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241046400 00000100:00100000:0.0:1788875029.331574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788875029.331589:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241046528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788875029.332047:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788875029.332059:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875029.332088:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788875029.332534:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241046528:12345-0@lo:400:kworker.0 Request processed in 945us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875029.332546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788875029.332574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788875029.332584:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241046400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875029.332675:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241046400:12345-0@lo:400:kworker.0 Request processed in 93us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875029.332682:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788875029.332756:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241046528:0@lo:400:kworker.0 00010000:00080000:0.0:1788875029.332804:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37fb80 x1875771241046656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875029.332818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241046656:0@lo:400:kworker.0 00000100:00100000:2.0:1788875029.333861:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241046784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875029.333971:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241046784:12345-0@lo:400:kworker.0 Request processed in 1873us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875029.333983:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788875029.335020:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241046400:0@lo:400:kworker.0 00000100:00100000:1.0:1788875029.335040:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241046784:0@lo:400:kworker.0 00000100:00100000:1.0:1788875029.838078:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788875029.838113:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241047040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875029.838183:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875029.838302:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047040 00000100:00100000:2.0:1788875029.838312:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047040 00000100:00100000:2.0:1788875029.838371:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788875029.838380:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241047040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875029.838417:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875029.838478:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241047040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875029.838494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788875029.838599:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d278700 x1875771241047040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875029.838625:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241047040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875030.291854:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875031.310975:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875032.333887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875033.358952:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875033.379139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875033.379184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875033.379211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945344 00000100:00100000:3.0:1788875033.379221:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945344 00000100:00100000:3.0:1788875033.379342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1788875033.379354:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217945344:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875033.379437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217945344:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875033.379446:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1788875033.379489:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945216 00000100:00100000:3.0:1788875033.379494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945216 00000100:00100000:3.0:1788875033.379518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00100000:3.0:1788875033.379525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2350:x1875771217945216:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875033.379551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2350:x1875771217945216:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875033.379558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00080000:3.0:1788875033.379589:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875033.939712:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875033.939743:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241047168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875033.939852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875033.939928:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047168 00000100:00100000:3.0:1788875033.939937:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047168 00000100:00100000:3.0:1788875033.939993:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788875033.940000:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241047168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875033.940033:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875033.940084:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241047168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875033.940091:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788875033.940109:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788875033.940412:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37fb80 x1875771241047168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875033.940432:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241047168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788875034.388395:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875034.453903:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241047552:0@lo:400:kworker.0 00000100:00100000:3.0:1788875034.453979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875034.454199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047552 00000100:00100000:0.0:1788875034.454209:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047552 00000100:00100000:0.0:1788875034.454271:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788875034.454282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875034.454339:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241047552:12345-0@lo:400:kworker.0 Request processed in 59us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875034.454346:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788875034.454366:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875034.454460:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241047552:0@lo:400:kworker.0 00000100:00100000:3.0:1788875034.454482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875034.454489:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241047680:0@lo:400:kworker.0 00000100:00100000:3.0:1788875034.454519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875034.454986:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047680 00000100:00100000:0.0:1788875034.454991:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047680 00000100:00100000:0.0:1788875034.455033:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788875034.455040:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241047680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875034.455097:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241047680:12345-0@lo:400:kworker.0 Request processed in 56us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875034.455110:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788875034.455154:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37fb80 x1875771241047680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875034.455165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241047680:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.455762:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241047296:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.455838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875034.455897:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241047808:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.455926:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875034.455951:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788875034.455957:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241047424:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.455975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875034.455993:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241047936:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.456025:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875034.456364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047808 00000100:00100000:2.0:1788875034.456371:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047808 00000100:00100000:2.0:1788875034.456416:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047424 00000100:00100000:2.0:1788875034.456420:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047424 00000100:00100000:2.0:1788875034.456433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788875034.456453:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241047808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.456498:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241047808:12345-0@lo:400:kworker.0 Request processed in 58us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875034.456504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788875034.456518:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788875034.456523:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.456551:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241047424:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875034.456556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788875034.456575:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047936 00000100:00100000:2.0:1788875034.456578:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047936 00000100:00100000:2.0:1788875034.456600:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788875034.456605:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241047936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.456631:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241047936:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875034.456647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788875034.456666:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788875034.456671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875034.456699:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241047424:0@lo:400:kworker.0 00010000:00080000:2.0:1788875034.456711:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37df80 x1875771241047936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875034.456722:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241047936:0@lo:400:kworker.0 00000100:00100000:2.0:1788875034.456732:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241047808:0@lo:400:kworker.0 00000100:00100000:3.0:1788875034.456849:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241047296 00000100:00100000:3.0:1788875034.456854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241047296 00000100:00100000:3.0:1788875034.456980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788875034.456990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875034.457040:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241047296:12345-0@lo:400:kworker.0 Request processed in 53us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875034.457057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788875034.461971:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241047296:0@lo:400:kworker.0 00000100:00100000:0.0:1788875034.958209:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875034.958302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875034.958428:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048064 00000100:00100000:3.0:1788875034.958462:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048064 00000100:00100000:3.0:1788875034.958523:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788875034.958532:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875034.958569:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875034.959067:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 535us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875034.959076:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788875034.959249:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d278380 x1875771241048064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875034.959269:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875035.410681:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875036.430953:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875037.456551:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875038.481229:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875038.496468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875038.496517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875038.496609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945472 00000100:00100000:2.0:1788875038.496619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945472 00000100:00100000:2.0:1788875038.496674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:2.0:1788875038.496684:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217945472:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875038.496750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2348:x1875771217945472:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875038.496758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:0.0:1788875038.497982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945600 00000100:00100000:0.0:1788875038.497992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945600 00000100:00100000:0.0:1788875038.498060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:0.0:1788875038.498070:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217945600:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875038.498135:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217945600:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 67us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875038.498142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00080000:2.0:1788875038.499641:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875039.058237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875039.058263:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875039.058339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.063478:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048192 00000100:00100000:3.0:1788875039.063495:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048192 00000100:00100000:3.0:1788875039.063573:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788875039.063586:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875039.063627:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875039.063714:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (5374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.063721:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788875039.063754:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788875039.063787:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37fb80 x1875771241048192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875039.063810:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788875039.505677:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875039.566406:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241048320:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.566486:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.566543:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241048832:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.566569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.566592:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788875039.566610:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241048448:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.566635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.566654:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.566677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.566704:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241048576:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.566727:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.566745:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875039.566750:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048704:0@lo:400:kworker.0 00000100:00100000:0.0:1788875039.567297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048320 00000100:00100000:0.0:1788875039.567307:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048320 00000100:00100000:0.0:1788875039.567365:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788875039.567375:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241048320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875039.567444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241048320:12345-0@lo:400:kworker.0 Request processed in 70us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875039.567453:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788875039.567865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875039.567914:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048832 00000100:00100000:3.0:1788875039.567919:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048832 00000100:00100000:3.0:1788875039.568005:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048448 00000100:00100000:3.0:1788875039.568009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048448 00000100:00100000:3.0:1788875039.568023:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048576 00000100:00100000:3.0:1788875039.568025:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048576 00000100:00100000:3.0:1788875039.568038:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788875039.568045:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241048832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241048832:12345-0@lo:400:kworker.0 Request processed in 38us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.568089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788875039.568102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788875039.568107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241048448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241048448:12345-0@lo:400:kworker.0 Request processed in 26us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.568139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788875039.568151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788875039.568157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568199:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241048576:12345-0@lo:400:kworker.0 Request processed in 42us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.568205:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788875039.568223:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048960 00000100:00100000:3.0:1788875039.568227:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048960 00000100:00100000:3.0:1788875039.568247:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241048704 00000100:00100000:3.0:1788875039.568250:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241048704 00000100:00100000:3.0:1788875039.568263:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788875039.568268:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568297:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241048960:12345-0@lo:400:kworker.0 Request processed in 29us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.568303:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788875039.568314:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788875039.568320:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568345:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241048704:12345-0@lo:400:kworker.0 Request processed in 26us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875039.568351:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788875039.568368:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875039.568372:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875039.568409:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241048448:0@lo:400:kworker.0 00010000:00080000:3.0:1788875039.568424:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37f480 x1875771241048960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875039.568436:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568445:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241048320:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568453:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241048832:0@lo:400:kworker.0 00010000:00080000:3.0:1788875039.568497:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37f800 x1875771241048704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875039.568507:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241048704:0@lo:400:kworker.0 00000100:00100000:3.0:1788875039.568517:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241048576:0@lo:400:kworker.0 00000100:00100000:2.0:1788875040.080582:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241049088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875040.080681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875040.080801:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049088 00000100:00100000:3.0:1788875040.080810:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049088 00000100:00100000:3.0:1788875040.080855:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788875040.080864:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241049088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875040.080898:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875040.080957:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241049088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875040.080964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788875040.081000:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a048d4380 x1875771241049088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875040.081017:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241049088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875040.528190:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875041.550173:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875042.575578:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875043.598040:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875043.612930:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875043.613065:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945728 00000100:00100000:2.0:1788875043.613075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945728 00000100:00100000:2.0:1788875043.613141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 209 00000100:00100000:2.0:1788875043.613152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217945728:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875043.613236:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+10:2349:x1875771217945728:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875043.613245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 209 00000100:00100000:3.0:1788875043.616608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875043.616733:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945856 00000100:00100000:0.0:1788875043.616756:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945856 00000100:00100000:0.0:1788875043.616868:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:0.0:1788875043.616878:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217945856:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875043.616983:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217945856:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 106us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875043.616990:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00080000:3.0:1788875043.617204:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788875043.756860:0:10127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:44:02 (1788875042) === 00000100:00100000:3.0:1788875044.181001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.181146:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217945984 00000100:00100000:1.0:1788875044.181160:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217945984 00000100:00100000:1.0:1788875044.181234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:1.0:1788875044.181248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+10:8136:x1875771217945984:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788875044.181272:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875044.181297:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b27400/0x60858e6020d822bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0a79 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875044.181337:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b27400/0x60858e6020d822bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a79 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875044.181362:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b27400/0x60858e6020d822bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a79 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875044.181374:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27400, rc 0) 00000100:00100000:1.0:1788875044.181444:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217945984:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 200us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.181452:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:3.0:1788875044.182703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875044.187155:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241049216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875044.187298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875044.188207:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049216 00000100:00100000:1.0:1788875044.188230:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049216 00000100:00100000:1.0:1788875044.188371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788875044.188384:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241049216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875044.188433:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875044.188525:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241049216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.188533:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788875044.188642:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d37dc00 x1875771241049216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875044.188668:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241049216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788875044.197843:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875044.198055:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875044.198231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946112 00000100:00100000:0.0:1788875044.198246:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946112 00000100:00100000:0.0:1788875044.198315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:0.0:1788875044.198328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217946112:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788875044.201500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217946112:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 3159us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.201519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:3.0:1788875044.204825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875044.205440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946240 00000100:00100000:2.0:1788875044.205455:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946240 00000100:00100000:2.0:1788875044.205539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:2.0:1788875044.205550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217946240:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788875044.205929:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217946240:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 381us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.205939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:3.0:1788875044.218421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.218513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946368 00000100:00100000:1.0:1788875044.218528:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946368 00000100:00100000:1.0:1788875044.218606:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:1.0:1788875044.218620:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+11:8140:x1875771217946368:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788875044.219057:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+11:8140:x1875771217946368:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 438us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.219066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:0.0:1788875044.237911:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875044.238166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946496 00000100:00100000:2.0:1788875044.238184:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946496 00000100:00100000:2.0:1788875044.240221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:2.0:1788875044.240253:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+11:8140:x1875771217946496:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875044.240644:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+11:8140:x1875771217946496:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 406us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.241355:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:0.0:1788875044.249048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875044.251184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946624 00000100:00100000:2.0:1788875044.251204:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946624 00000100:00100000:2.0:1788875044.251293:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:2.0:1788875044.251303:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+11:8136:x1875771217946624:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788875044.251324:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875044.251358:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18800/0x60858e6020d822c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0aa3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.251401:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18800/0x60858e6020d822c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aa3 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.251415:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18800/0x60858e6020d822c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aa3 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.251429:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18800, rc 0) 00000100:00100000:2.0:1788875044.251511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:8136:x1875771217946624:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 210us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.251519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:0.0:1788875044.258088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875044.258294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946752 00000100:00100000:2.0:1788875044.258308:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946752 00000100:00100000:2.0:1788875044.258388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:2.0:1788875044.258400:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:8136:x1875771217946752:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788875044.258435:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788875044.258470:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788875044.258476:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788875044.258479:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788875044.258482:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788875044.265681:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:8136:x1875771217946752:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 7256us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.265716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:0.0:1788875044.270000:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.273790:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217946880 00000100:00100000:3.0:1788875044.273835:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217946880 00000100:00100000:2.0:1788875044.274494:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:2.0:1788875044.274509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:8136:x1875771217946880:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788875044.274535:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875044.274562:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0aaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.274601:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.274615:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875044.274626:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18600, rc 0) 00000100:00100000:2.0:1788875044.274731:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:8136:x1875771217946880:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 226us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.274740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:0.0:1788875044.277925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.278437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947008 00000100:00100000:1.0:1788875044.278451:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947008 00000100:00100000:1.0:1788875044.278508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:1.0:1788875044.278518:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8136:x1875771217947008:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788875044.279255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8136:x1875771217947008:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 734us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.279266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:0.0:1788875044.283915:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.284068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947136 00000100:00100000:3.0:1788875044.284081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947136 00000100:00100000:3.0:1788875044.284154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:3.0:1788875044.284167:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8136:x1875771217947136:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788875044.284482:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8136:x1875771217947136:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 318us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.284492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:0.0:1788875044.292082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.292446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947264 00000100:00100000:3.0:1788875044.292459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947264 00000100:00100000:3.0:1788875044.292537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:3.0:1788875044.292550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8144:x1875771217947264:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788875044.293504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:8144:x1875771217947264:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 949us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.293516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:0.0:1788875044.300457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.301051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947392 00000100:00100000:1.0:1788875044.301069:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947392 00000100:00100000:1.0:1788875044.301231:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:1.0:1788875044.301244:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:8144:x1875771217947392:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788875044.301596:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:8144:x1875771217947392:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 353us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.301606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:0.0:1788875044.308847:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.309023:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947776 00000100:00100000:3.0:1788875044.309047:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947776 00000100:00100000:3.0:1788875044.309137:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875044.309152:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217947776:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875044.309262:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217947776:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 114us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.309271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1788875044.319307:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875044.323007:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947520 00000100:00100000:2.0:1788875044.323096:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947520 00000100:00100000:2.0:1788875044.323827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875044.323903:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875771217947520:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788875044.323947:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9147e8f4-0bb3-42d1-8da6-705940ef7b80@192.168.202.7@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1788875044.323999:0:5841:0:(genops.c:1385:class_connect()) connect: client 9147e8f4-0bb3-42d1-8da6-705940ef7b80, cookie 0x60858e6020d822d4 00000004:00100000:2.0:1788875044.324212:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788875044.324581:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9e5a35a8c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875044.325999:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2346:x1875771217947520:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 2148us (6695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.326207:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1788875044.337303:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875044.337456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.344356:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947648 00000100:00100000:3.0:1788875044.344378:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947648 00000100:00080000:0.0:1788875044.344569:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875044.349172:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217947904 00000100:00100000:3.0:1788875044.349198:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217947904 00000100:00100000:2.0:1788875044.349574:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875044.349590:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+7:0:x1875771217947648:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875044.349651:0:8216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875044.351996:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+7:0:x1875771217947648:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 2398us (14696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.352012:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875044.352064:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1788875044.352080:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217947904:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875044.352121:0:8216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875044.352157:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217947904:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 84us (14702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875044.356813:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875044.357759:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948032 00000100:00100000:3.0:1788875044.357960:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948032 00000100:00100000:2.0:1788875044.359091:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1788875044.362569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1788875044.362606:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217948032:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788875044.362758:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217948032:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 164us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.362766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875044.366234:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.366307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948416 00000100:00100000:0.0:1788875044.366307:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875044.366326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948416 00000100:00100000:1.0:1788875044.366419:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1788875044.366431:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217948416:12345-192.168.202.7@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788875044.366562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000004:00200000:1.0:1788875044.366621:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788875044.366796:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:8136:x1875771217948416:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 340us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.366805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1788875044.372498:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948160 00000100:00100000:3.0:1788875044.372516:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948160 00000100:00100000:3.0:1788875044.372626:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948288 00000100:00100000:3.0:1788875044.372630:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948288 00000100:00100000:3.0:1788875044.372669:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1788875044.372678:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875771217948160:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788875044.372712:0:6901:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9147e8f4-0bb3-42d1-8da6-705940ef7b80@192.168.202.7@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788875044.372746:0:6901:0:(genops.c:1385:class_connect()) connect: client 9147e8f4-0bb3-42d1-8da6-705940ef7b80, cookie 0x60858e6020d822db 00002000:00100000:3.0:1788875044.372761:0:6901:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9147e8f4-0bb3-42d1-8da6-705940ef7b80/ffff9e5a06241000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788875044.372788:0:6901:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788875044.374928:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875044.374942:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875771217948288:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788875044.374980:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9147e8f4-0bb3-42d1-8da6-705940ef7b80@192.168.202.7@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1788875044.375012:0:6697:0:(genops.c:1385:class_connect()) connect: client 9147e8f4-0bb3-42d1-8da6-705940ef7b80, cookie 0x60858e6020d822e2 00002000:00100000:0.0:1788875044.375025:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9147e8f4-0bb3-42d1-8da6-705940ef7b80/ffff9e5a3d330000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788875044.375047:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788875044.375273:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788875044.375309:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e5a3d335000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788875044.375401:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2346:x1875771217948288:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 459us (8839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875044.375409:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00002000:00080000:1.0:1788875044.378092:0:6901:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788875044.378133:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5a04660000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788875044.378198:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2346:x1875771217948160:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 5519us (11893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875044.378208:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00010000:00010000:2.0:1788875044.622263:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875044.686555:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241049728:0@lo:400:kworker.0 00000100:00100000:2.0:1788875044.686648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875044.686734:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875044.686740:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241049600:0@lo:400:kworker.0 00000100:00100000:2.0:1788875044.686812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875044.686850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049728 00000100:00100000:2.0:1788875044.686858:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049728 00000100:00100000:2.0:1788875044.686918:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049600 00000100:00100000:2.0:1788875044.686921:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049600 00000100:00100000:2.0:1788875044.686941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788875044.686950:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875044.687010:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241049728:12345-0@lo:400:kworker.0 Request processed in 61us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.687017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788875044.687048:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788875044.687054:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241049600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875044.687076:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241049600:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875044.687081:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788875044.687120:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241049600:0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687269:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241049344:0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687305:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875044.687329:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241049856:0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687368:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875044.687386:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875044.687391:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241049472:0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875044.687430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049472 00000100:00100000:3.0:1788875044.687433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049472 00000100:00100000:3.0:1788875044.687462:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788875044.687467:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241049472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241049472:12345-0@lo:400:kworker.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.687513:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788875044.687534:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241049472:0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049344 00000100:00100000:3.0:1788875044.687564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049344 00000100:00100000:3.0:1788875044.687587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788875044.687592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875044.687622:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241049344:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875044.687627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788875044.687650:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241049344:0@lo:400:kworker.0 00000100:00100000:2.0:1788875044.687753:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241049728:0@lo:400:kworker.0 00000100:00080000:0.0:1788875044.687904:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875044.687923:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049856 00000100:00100000:0.0:1788875044.687926:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049856 00000100:00100000:0.0:1788875044.687974:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788875044.687982:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875044.688037:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241049856:12345-0@lo:400:kworker.0 Request processed in 57us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875044.688043:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788875044.688252:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d278000 x1875771241049856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875044.688267:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241049856:0@lo:400:kworker.0 00000100:00080000:2.0:1788875044.688313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875045.199684:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875045.199721:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241049984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875045.199948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875045.200335:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241049984 00000100:00100000:1.0:1788875045.200356:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241049984 00000100:00100000:1.0:1788875045.200417:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788875045.200427:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241049984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875045.200456:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875045.200513:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241049984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875045.200521:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788875045.200584:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a04f01500 x1875771241049984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875045.200606:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241049984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788875045.646423:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875046.672948:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788875047.331727:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00010000:00010000:2.0:1788875047.694769:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788875047.830580:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000001:00100000:2.0:1788875048.340935:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00010000:00010000:2.0:1788875048.719510:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875049.297056:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241050112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875049.297142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875049.297381:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050112 00000100:00100000:3.0:1788875049.297389:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050112 00000100:00100000:3.0:1788875049.297455:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788875049.297465:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241050112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875049.297500:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875049.297552:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241050112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875049.297582:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788875049.297626:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35436d80 x1875771241050112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875049.297644:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241050112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875049.297889:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788875049.743371:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875049.764669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875049.764736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875049.764797:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875049.764826:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875049.764869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875049.764910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948800 00000100:00100000:0.0:1788875049.764923:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948800 00000100:00100000:3.0:1788875049.765092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948544 00000100:00100000:3.0:1788875049.765097:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948544 00000100:00100000:3.0:1788875049.765140:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:3.0:1788875049.765153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217948544:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875049.765250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217948544:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875049.765259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:0.0:1788875049.766022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948672 00000100:00100000:0.0:1788875049.766032:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948672 00000100:00100000:0.0:1788875049.766075:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1788875049.766092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217948800:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875049.766152:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217948800:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 68us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.766160:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1788875049.766178:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1788875049.766184:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217948672:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875049.766210:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217948672:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.766216:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1788875049.766238:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949056 00000100:00100000:0.0:1788875049.766242:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949056 00000100:00100000:0.0:1788875049.766271:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217948928 00000100:00100000:0.0:1788875049.766275:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217948928 00000100:00100000:0.0:1788875049.766314:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1788875049.766322:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217949056:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875049.766349:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217949056:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.766355:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1788875049.766366:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:0.0:1788875049.766372:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217948928:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875049.766411:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217948928:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 40us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.766418:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00080000:0.0:1788875049.766448:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788875049.766453:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875049.766456:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875049.807651:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241050240:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.807768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875049.807852:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241050752:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.807885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875049.807919:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788875049.807925:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241050624:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.807953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875049.808002:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241050496:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875049.808050:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788875049.808055:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808078:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875049.808112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050240 00000100:00100000:0.0:1788875049.808122:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050240 00000100:00100000:0.0:1788875049.808183:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788875049.808194:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808254:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241050240:12345-0@lo:400:kworker.0 Request processed in 61us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.808262:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788875049.808344:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050624 00000100:00100000:0.0:1788875049.808348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050624 00000100:00100000:0.0:1788875049.808388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050496 00000100:00100000:0.0:1788875049.808391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050496 00000100:00100000:0.0:1788875049.808404:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050368 00000100:00100000:0.0:1788875049.808407:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050368 00000100:00100000:0.0:1788875049.808419:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788875049.808425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241050624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241050624:12345-0@lo:400:kworker.0 Request processed in 35us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.808467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788875049.808479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788875049.808485:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241050496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808519:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241050496:12345-0@lo:400:kworker.0 Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.808525:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788875049.808536:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788875049.808541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808568:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241050368:12345-0@lo:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.808573:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788875049.808600:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875049.808640:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808651:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241050496:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808684:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050752 00000100:00100000:0.0:1788875049.808688:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050752 00000100:00100000:0.0:1788875049.808720:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788875049.808736:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241050752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808794:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241050752:12345-0@lo:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875049.808802:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788875049.808822:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875049.808844:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241050624:0@lo:400:kworker.0 00000100:00100000:0.0:1788875049.808852:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241050240:0@lo:400:kworker.0 00010000:00080000:0.0:1788875049.808865:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35437b80 x1875771241050752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875049.808876:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241050752:0@lo:400:kworker.0 00000001:02000400:2.0:1788875050.238859:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788875050.318900:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875050.319022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875050.320461:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241050880 00000100:00100000:3.0:1788875050.320476:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241050880 00000100:00100000:3.0:1788875050.320558:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788875050.320573:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241050880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875050.320629:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875050.320723:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241050880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875050.320734:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788875050.322607:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a04f03480 x1875771241050880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875050.322646:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241050880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875050.767445:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875051.792143:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875052.813883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875053.841318:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875054.418797:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875054.420822:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241051008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875054.420907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875054.425680:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051008 00000100:00100000:1.0:1788875054.425696:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051008 00000100:00100000:1.0:1788875054.425884:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788875054.425898:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241051008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875054.425949:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875054.426042:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241051008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.426049:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788875054.426194:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35437b80 x1875771241051008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875054.426218:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241051008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875054.439705:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788875054.862973:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875054.883886:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875054.883923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875054.883977:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875054.884010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949696 00000100:00100000:0.0:1788875054.884018:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949696 00000100:00100000:0.0:1788875054.884088:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:0.0:1788875054.884098:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217949696:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875054.884164:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217949696:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875054.884181:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00080000:0.0:1788875054.884202:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875054.884419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949184 00000100:00100000:3.0:1788875054.884435:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949184 00000100:00100000:3.0:1788875054.884472:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:3.0:1788875054.884479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217949184:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875054.884512:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217949184:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875054.884518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:1.0:1788875054.884884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949440 00000100:00100000:1.0:1788875054.884890:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949440 00000100:00100000:1.0:1788875054.884951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:1.0:1788875054.884961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217949440:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875054.885002:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217949440:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 45us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.885009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00080000:3.0:1788875054.885348:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875054.893880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875054.893930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875054.894115:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949568 00000100:00100000:1.0:1788875054.894127:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949568 00000100:00100000:1.0:1788875054.894349:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:1.0:1788875054.894361:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217949568:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875054.894443:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217949568:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 84us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.894451:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:2.0:1788875054.894550:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949312 00000100:00100000:2.0:1788875054.894555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949312 00000100:00100000:2.0:1788875054.894598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:2.0:1788875054.894605:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217949312:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875054.894635:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217949312:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 31us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875054.894641:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00080000:3.0:1788875054.894738:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788875054.894743:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875054.927015:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241051264:0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.927103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241051136:0@lo:400:kworker.0 00000100:00100000:3.0:1788875054.927205:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875054.927268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875054.927280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241051392:0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.927293:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241051648:0@lo:400:kworker.0 00000100:00100000:3.0:1788875054.927306:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875054.927316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875054.927324:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875054.927330:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241051520:0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.927345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051264 00000100:00100000:3.0:1788875054.927348:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875054.927352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051264 00000100:00100000:1.0:1788875054.935438:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051648 00000100:00100000:1.0:1788875054.935452:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051648 00000100:00100000:1.0:1788875054.935517:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788875054.935527:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.935630:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241051648:12345-0@lo:400:kworker.0 Request processed in 105us (8312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.935638:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788875054.935686:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35258a80 x1875771241051648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875054.935701:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241051648:0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.935726:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051392 00000100:00100000:1.0:1788875054.935730:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051392 00000100:00100000:1.0:1788875054.935749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051520 00000100:00100000:1.0:1788875054.935751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051520 00000100:00100000:1.0:1788875054.935764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788875054.935805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.935848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241051264:12345-0@lo:400:kworker.0 Request processed in 44us (8644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.935853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788875054.935864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788875054.935869:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241051392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.935895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241051392:12345-0@lo:400:kworker.0 Request processed in 27us (8589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.935901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788875054.935909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788875054.935914:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.935937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241051520:12345-0@lo:400:kworker.0 Request processed in 23us (8588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.935942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788875054.936638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241051264:0@lo:400:kworker.0 00000100:00080000:3.0:1788875054.936664:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788875054.936670:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875054.936687:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241051520:0@lo:400:kworker.0 00000100:00100000:3.0:1788875054.936698:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241051392:0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.937333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051136 00000100:00100000:1.0:1788875054.937341:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051136 00000100:00100000:1.0:1788875054.937385:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788875054.937394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875054.937465:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241051136:12345-0@lo:400:kworker.0 Request processed in 73us (10197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875054.937473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788875054.937545:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241051136:0@lo:400:kworker.0 00000100:00100000:3.0:1788875055.440729:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875055.440752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875055.440851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875055.440937:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051776 00000100:00100000:3.0:1788875055.440954:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051776 00000100:00100000:3.0:1788875055.441000:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788875055.441008:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241051776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875055.441054:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875055.441096:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241051776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875055.441103:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788875055.441142:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35258700 x1875771241051776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875055.441159:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241051776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875055.885939:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875056.916213:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875057.934983:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875058.959084:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875059.535378:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241051904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875059.535453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875059.535547:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241051904 00000100:00100000:3.0:1788875059.535555:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241051904 00000100:00100000:3.0:1788875059.535606:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788875059.535616:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241051904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875059.535651:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875059.535695:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241051904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875059.535702:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788875059.535722:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788875059.535751:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35258700 x1875771241051904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875059.535793:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241051904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788875059.982074:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875060.006077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875060.006119:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875060.006150:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875060.006178:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950336 00000100:00100000:1.0:1788875060.006187:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950336 00000100:00100000:1.0:1788875060.006265:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:1.0:1788875060.006276:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950336:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875060.006346:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950336:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.006353:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00080000:1.0:1788875060.006375:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875060.006413:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875060.006437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950080 00000100:00100000:1.0:1788875060.006441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950080 00000100:00100000:1.0:1788875060.006590:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949952 00000100:00100000:1.0:1788875060.006595:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949952 00000100:00100000:1.0:1788875060.006671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:1.0:1788875060.006679:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950080:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875060.006709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950080:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.006715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:1.0:1788875060.006726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:1.0:1788875060.006734:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217949952:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875060.006793:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217949952:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 37us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.006800:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00080000:1.0:1788875060.006818:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875060.007062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875060.007082:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950208 00000100:00100000:1.0:1788875060.007086:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950208 00000100:00100000:1.0:1788875060.007117:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:1.0:1788875060.007123:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950208:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875060.007155:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217950208:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.007162:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00080000:1.0:1788875060.007181:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875060.008013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217949824 00000100:00100000:0.0:1788875060.008021:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217949824 00000100:00100000:0.0:1788875060.008060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:0.0:1788875060.008069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217949824:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875060.008112:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217949824:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 45us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875060.008120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:1.0:1788875060.047112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241052288:0@lo:400:kworker.0 00000100:00100000:1.0:1788875060.047186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875060.047460:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241052032:0@lo:400:kworker.0 00000100:00100000:0.0:1788875060.047716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052288 00000100:00100000:0.0:1788875060.047724:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052288 00000100:00100000:0.0:1788875060.047801:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788875060.047811:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241052288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875060.048449:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241052416:0@lo:400:kworker.0 00000100:00100000:3.0:1788875060.050648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875060.050730:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241052544:0@lo:400:kworker.0 00000100:00100000:3.0:1788875060.050793:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875060.050847:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241052160:0@lo:400:kworker.0 00000100:00100000:3.0:1788875060.050875:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875060.050928:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052032 00000100:00100000:3.0:1788875060.051125:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052032 00000100:00100000:3.0:1788875060.051174:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788875060.051182:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241052032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875060.051255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241052032:12345-0@lo:400:kworker.0 Request processed in 73us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875060.051263:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788875060.051294:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052544 00000100:00100000:3.0:1788875060.051297:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052544 00000100:00100000:3.0:1788875060.051327:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788875060.051333:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241052544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875060.051376:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241052544:12345-0@lo:400:kworker.0 Request processed in 43us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875060.051382:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788875060.051413:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241052032:0@lo:400:kworker.0 00010000:00080000:3.0:1788875060.051428:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d034a80 x1875771241052544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875060.051440:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241052544:0@lo:400:kworker.0 00000100:00080000:1.0:1788875060.052481:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788875060.052488:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875060.052502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052160 00000100:00100000:1.0:1788875060.052509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052160 00000100:00100000:1.0:1788875060.052574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788875060.052583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241052160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875060.052646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241052160:12345-0@lo:400:kworker.0 Request processed in 65us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.052653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788875060.052695:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241052160:0@lo:400:kworker.0 00000100:00100000:0.0:1788875060.053577:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241052288:12345-0@lo:400:kworker.0 Request processed in 5764us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875060.053586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788875060.054351:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875060.054445:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241052288:0@lo:400:kworker.0 00000100:00100000:1.0:1788875060.054562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052416 00000100:00100000:1.0:1788875060.054569:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052416 00000100:00100000:1.0:1788875060.054643:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788875060.054651:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241052416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875060.054703:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241052416:12345-0@lo:400:kworker.0 Request processed in 53us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875060.054710:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788875060.054763:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875060.054999:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241052416:0@lo:400:kworker.0 00000100:00100000:0.0:1788875060.558184:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788875060.558219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875060.558297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875060.558795:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052672 00000100:00100000:3.0:1788875060.558813:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052672 00000100:00100000:3.0:1788875060.558863:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788875060.558872:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241052672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875060.558906:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875060.559123:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241052672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 251us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875060.559131:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788875060.559216:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3525a680 x1875771241052672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875060.559236:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241052672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875061.011655:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875062.030402:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875063.056019:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875064.077995:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875064.654180:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875064.654207:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241052800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875064.654284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875064.654533:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052800 00000100:00100000:3.0:1788875064.654541:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052800 00000100:00100000:3.0:1788875064.654611:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788875064.654622:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241052800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875064.654658:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788875064.654835:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3525b100 x1875771241052800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875064.654855:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241052800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875064.654918:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875064.654964:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241052800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875064.654974:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788875065.104061:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875065.124856:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875065.124910:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875065.124950:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875065.124979:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875065.125066:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875065.125094:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950720 00000100:00100000:0.0:1788875065.125103:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950720 00000100:00100000:0.0:1788875065.125164:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950592 00000100:00100000:0.0:1788875065.125168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950592 00000100:00100000:0.0:1788875065.125193:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:0.0:1788875065.125202:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217950720:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875065.125370:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950464 00000100:00100000:2.0:1788875065.125381:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950464 00000100:00100000:2.0:1788875065.125410:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:2.0:1788875065.125417:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217950464:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875065.125545:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1788875065.125556:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217950592:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875065.125623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217950720:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 420us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.125631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:0.0:1788875065.125653:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950848 00000100:00100000:0.0:1788875065.125657:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950848 00000100:00100000:0.0:1788875065.125682:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217950976 00000100:00100000:0.0:1788875065.125685:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217950976 00000100:00100000:0.0:1788875065.125702:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1788875065.125707:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c6e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2346:x1875771217950848:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:0.0:1788875065.125726:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d822db 00000100:00080000:0.0:1788875065.125735:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9e5a04660000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788875065.125796:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788875065.141134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217950464:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 15704us (16275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875065.141161:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:3.0:1788875065.141865:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217950592:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 16304us (16907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875065.141876:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1788875065.141922:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:3.0:1788875065.141936:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2346:x1875771217950976:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:3.0:1788875065.141983:0:6901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d822e2 00000100:00080000:3.0:1788875065.141995:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5a3d335000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788875065.142036:0:6901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788875065.142384:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+2:2346:x1875771217950976:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 452us (17316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875065.142391:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:3.0:1788875065.142416:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788875065.143167:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875065.143173:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788875065.143177:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875065.150299:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c6e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+2:2346:x1875771217950848:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 24575us (25303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.150315:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00010000:00010000:0.0:1788875065.150504:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875065.167243:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241053184:0@lo:400:kworker.0 00000100:00100000:3.0:1788875065.167329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875065.167386:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875065.167393:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241053312:0@lo:400:kworker.0 00000100:00100000:3.0:1788875065.167422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875065.167458:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053312 00000100:00100000:3.0:1788875065.167467:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053312 00000100:00100000:3.0:1788875065.167513:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788875065.167522:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241053312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875065.167572:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241053312:12345-0@lo:400:kworker.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875065.167580:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788875065.167622:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35259500 x1875771241053312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875065.167637:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241053312:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.167803:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241052928:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.167864:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875065.167893:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.167917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875065.167939:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788875065.167945:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241053056:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.167967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875065.167985:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241053568:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875065.168033:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053184 00000100:00100000:0.0:1788875065.168037:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053184 00000100:00100000:0.0:1788875065.168071:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053440 00000100:00100000:0.0:1788875065.168074:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053440 00000100:00100000:0.0:1788875065.168090:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053056 00000100:00100000:0.0:1788875065.168092:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053056 00000100:00100000:0.0:1788875065.168105:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788875065.168112:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168162:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241053184:12345-0@lo:400:kworker.0 Request processed in 51us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.168169:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788875065.168183:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788875065.168189:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168223:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241053440:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.168229:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788875065.168240:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788875065.168245:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168295:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241053056:12345-0@lo:400:kworker.0 Request processed in 49us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.168301:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788875065.168321:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053568 00000100:00100000:0.0:1788875065.168325:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053568 00000100:00100000:0.0:1788875065.168350:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788875065.168355:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168383:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241053568:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875065.168389:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788875065.168404:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875065.168408:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875065.168429:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241053184:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168453:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241053056:0@lo:400:kworker.0 00010000:00080000:0.0:1788875065.168464:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3525b100 x1875771241053568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875065.168474:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241053568:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.168483:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241053440:0@lo:400:kworker.0 00000100:00100000:3.0:1788875065.168704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241052928 00000100:00100000:3.0:1788875065.168716:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241052928 00000100:00100000:3.0:1788875065.168753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788875065.168760:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241052928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875065.168811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241052928:12345-0@lo:400:kworker.0 Request processed in 52us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875065.168818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788875065.168868:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241052928:0@lo:400:kworker.0 00000100:00100000:0.0:1788875065.678532:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875065.678604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875065.678741:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053696 00000100:00100000:3.0:1788875065.678749:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053696 00000100:00100000:3.0:1788875065.678821:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788875065.678830:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241053696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875065.678867:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875065.678930:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241053696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875065.678937:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788875065.679283:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3525a300 x1875771241053696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875065.679301:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241053696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875066.125981:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788875066.902380:0:11026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788875067.150177:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875068.179495:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788875068.289361:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000020:00000080:0.0:1788875068.289371:0:7652:0:(genops.c:885:class_export_put()) final put ffff9e5a3d330000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000020:00000080:1.0:1788875068.289443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3d330000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 for lustre-OST0001 00000020:00000080:1.0:1788875068.289495:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3d335000 for lustre-OST0001 00000001:00100000:1.0:1788875068.832462:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000020:00000080:1.0:1788875068.832472:0:6720:0:(genops.c:885:class_export_put()) final put ffff9e5a06241000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000020:00000080:2.0:1788875068.832540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06241000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 for lustre-OST0000 00000020:00000080:2.0:1788875068.832588:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a04660000 for lustre-OST0000 00010000:00010000:3.0:1788875069.199918:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875069.781297:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241053824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875069.781473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875069.781602:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053824 00000100:00100000:1.0:1788875069.781613:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053824 00000100:00100000:1.0:1788875069.781681:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788875069.781693:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241053824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875069.781741:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875069.781816:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241053824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875069.781823:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788875069.781901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788875069.781938:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35259500 x1875771241053824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875069.781962:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241053824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788875070.224553:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875070.242641:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875070.242701:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875070.242732:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875070.242768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951232 00000100:00100000:0.0:1788875070.242807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951232 00000100:00100000:1.0:1788875070.242972:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951104 00000100:00100000:1.0:1788875070.242977:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951104 00000100:00100000:1.0:1788875070.243050:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:1.0:1788875070.243062:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217951104:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875070.243166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217951104:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 107us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875070.243175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:0.0:1788875070.243386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951360 00000100:00100000:0.0:1788875070.243391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951360 00000100:00100000:0.0:1788875070.243414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:0.0:1788875070.243422:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217951232:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875070.243549:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:2.0:1788875070.243560:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217951360:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875070.243610:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217951360:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 53us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.243616:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:0.0:1788875070.244012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217951232:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 589us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875070.244020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00080000:1.0:1788875070.245583:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875070.286361:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788875070.286466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875070.286549:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875070.286555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241054336:0@lo:400:kworker.0 00000100:00100000:2.0:1788875070.286584:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875070.286631:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054336 00000100:00100000:2.0:1788875070.286640:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054336 00000100:00100000:2.0:1788875070.286699:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788875070.286723:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241054336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.286837:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788875070.286886:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241053952:0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.295827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875070.295939:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241054592:0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.295985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875070.296000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875070.296027:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241054464:0@lo:400:kworker.0 00000100:00100000:3.0:1788875070.296053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875070.296089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241053952 00000100:00100000:3.0:1788875070.296110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241053952 00000100:00100000:3.0:1788875070.296169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788875070.296178:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241053952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875070.296252:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241053952:12345-0@lo:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875070.296625:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788875070.296981:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241054336:12345-0@lo:400:kworker.0 Request processed in 10237us (10373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.296998:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788875070.297035:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054592 00000100:00100000:2.0:1788875070.297044:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054592 00000100:00100000:2.0:1788875070.297121:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788875070.297131:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875070.297220:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241054592:12345-0@lo:400:kworker.0 Request processed in 92us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.297228:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788875070.297265:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875070.298665:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054208 00000100:00100000:1.0:1788875070.298686:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054208 00000100:00100000:1.0:1788875070.298846:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054080 00000100:00100000:1.0:1788875070.298850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054080 00000100:00100000:1.0:1788875070.298869:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054464 00000100:00100000:1.0:1788875070.298873:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054464 00000100:00100000:1.0:1788875070.298904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788875070.298916:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.299046:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241054208:12345-0@lo:400:kworker.0 Request processed in 133us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875070.299055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788875070.299079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788875070.299085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241054080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.299128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241054080:12345-0@lo:400:kworker.0 Request processed in 43us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875070.299134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788875070.299145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788875070.299153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875070.299189:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241054464:12345-0@lo:400:kworker.0 Request processed in 38us (3136us total) trans 0 rc 0/0 00000100:00080000:0.0:1788875070.299258:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875070.299418:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788875070.300471:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241053952:0@lo:400:kworker.0 00000100:00100000:3.0:1788875070.300499:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241054464:0@lo:400:kworker.0 00010000:00080000:3.0:1788875070.301407:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a04f01f80 x1875771241054336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875070.301425:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241054336:0@lo:400:kworker.0 00000100:00100000:3.0:1788875070.301441:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788875070.304875:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241054080:0@lo:400:kworker.0 00010000:00080000:2.0:1788875070.304919:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a04f02a00 x1875771241054592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875070.304931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241054592:0@lo:400:kworker.0 00000020:00000080:1.0:1788875070.737708:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd05dcb0e0 20000000:00000080:1.0:1788875070.737727:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a3f7f7000 uarg=0000000000000000 20000000:01000000:1.0:1788875070.738078:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788875070.738084:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788875070.738145:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788875070.739016:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788875070.739226:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788875070.750987:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788875070.751027:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751047:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8228e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751055:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8229c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751061:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d822aa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751070:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751077:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751084:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751155:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751169:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 12 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.751185:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054720:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875070.751357:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751366:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.751375:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054848:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875070.751409:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751417:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.751427:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054976:0@lo:104: 00000100:00100000:1.0:1788875070.751470:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788875070.751583:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.751590:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 18 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.751599:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241055104:0@lo:104: 00000100:00100000:1.0:1788875070.751620:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788875070.752534:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.752545:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.752554:0:11176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241055232:0@lo:104: 00000100:00100000:1.0:1788875070.752598:0:11176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875070.753002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241054976 00000100:00100000:2.0:1788875070.753010:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241054976 00000100:00100000:2.0:1788875070.753052:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055104 00000100:00100000:2.0:1788875070.753055:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055104 00000100:00100000:2.0:1788875070.753079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788875070.753087:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:11176:x1875771241054976:12345-0@lo:104: 00010000:00010000:2.0:1788875070.753112:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753179:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788875070.753193:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:11176:x1875771241054976:12345-0@lo:104: Request processed in 107us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.753200:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788875070.753219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788875070.753225:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11176:x1875771241055104:12345-0@lo:104: 00010000:00010000:2.0:1788875070.753232:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753266:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788875070.753271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11176:x1875771241055104:12345-0@lo:104: Request processed in 47us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.753277:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788875070.753293:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875070.753299:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753305:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19a00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875070.753310:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753319:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875070.753327:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875070.753333:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875070.753364:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753380:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788875070.753398:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753404:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d822aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753418:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875070.753421:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753426:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875070.753429:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753435:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875070.753440:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875070.753446:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875070.753459:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753465:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788875070.753471:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753477:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27800/0x60858e6020d8229c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d822a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753493:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875070.753495:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875070.753496:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875070.753517:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241055488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875070.753550:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875070.753579:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875070.753585:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241055360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875070.753606:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875070.753636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055488 00000100:00100000:2.0:1788875070.753640:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055488 00010000:00010000:2.0:1788875070.753658:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 19 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875070.753678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055360 00000100:00100000:2.0:1788875070.753681:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055360 00010000:00010000:2.0:1788875070.753690:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 20 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875070.753703:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875070.753709:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+20:3306:x1875771241055488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875070.753719:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875070.753724:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 20 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753733:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 20 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.753761:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875070.753942:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+20:3306:x1875771241055488:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.753948:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875070.753985:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788875070.753990:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241055360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875070.753997:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875070.754001:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 19 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.754008:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 19 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.754017:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875070.754034:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241055360:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.754040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788875070.754076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241055360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875070.754086:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241055488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875070.754387:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875070.754700:0:11176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788875070.754718:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18200/0x60858e6020d822b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d822aa expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.754730:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054976:0@lo:104: 00010000:00010000:1.0:1788875070.754920:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a19600/0x60858e6020d822a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8229c expref: 17 pid: 5834 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.754930:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241055104:0@lo:104: 00000100:00100000:3.0:1788875070.755195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875070.755223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875070.755246:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951488 00000100:00100000:3.0:1788875070.755251:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951488 00010000:00010000:3.0:1788875070.755277:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 13 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875070.755298:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951616 00000100:00100000:3.0:1788875070.755301:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951616 00010000:00010000:3.0:1788875070.755313:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 14 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875070.755328:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788875070.755335:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+14:2348:x1875771217951488:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875070.755361:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875070.755367:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 14 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.755377:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 14 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.755392:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875070.755436:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+14:2348:x1875771217951488:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 101us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875070.755444:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788875070.755458:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1788875070.755464:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217951616:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875070.755472:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875070.755477:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 13 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.755486:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 13 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.755496:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875070.755515:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217951616:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875070.755522:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1788875070.756115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055232 00000100:00100000:2.0:1788875070.756121:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055232 00000100:00100000:2.0:1788875070.756149:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788875070.756156:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11176:x1875771241055232:12345-0@lo:104: 00010000:00010000:2.0:1788875070.756169:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875070.756216:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788875070.756222:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11176:x1875771241055232:12345-0@lo:104: Request processed in 67us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875070.756236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788875070.756299:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18600/0x60858e6020d822cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aaa expref: 12 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.756310:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054720:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875070.756320:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a19800/0x60858e6020d822b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a72 expref: 11 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875070.756327:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241054848:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875070.756335:0:11176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1875771241055232:0@lo:104: 00010000:00010000:1.0:1788875070.756366:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756506:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875070.756512:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756528:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875070.756532:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756539:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875070.756545:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875070.756550:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788875070.756618:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756624:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875070.756656:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756663:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26c00/0x60858e6020d8228e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82295 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.756678:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875070.756680:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875070.756682:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875070.756726:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241055616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875070.756828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875070.757082:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055616 00000100:00100000:3.0:1788875070.757087:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055616 00010000:00010000:3.0:1788875070.757116:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875070.757137:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788875070.757152:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+17:3303:x1875771241055616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875070.757163:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875070.757169:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757179:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757191:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8228e expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757203:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757211:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757224:0:8459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757232:0:8459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757238:0:8459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757244:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757250:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875070.757254:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757268:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757280:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875070.757289:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875070.757320:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241055616:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875070.757328:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788875070.757596:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.757605:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875070.757612:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27200/0x60858e6020d822e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875070.762943:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241055616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875070.806693:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241055744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875070.806803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875070.806862:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055744 00000100:00100000:0.0:1788875070.806869:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055744 00000100:00100000:0.0:1788875070.807026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788875070.807036:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241055744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875070.807074:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875070.807131:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241055744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875070.807139:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788875070.807180:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a362b0a80 x1875771241055744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875070.807213:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241055744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875071.246165:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875072.282446:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875072.607110:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875072.607496:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951744 00000100:00100000:2.0:1788875072.607507:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951744 00000100:00100000:2.0:1788875072.607576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00100000:2.0:1788875072.607588:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+11:5593:x1875771217951744:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875072.607608:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875072.607627:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ad4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.607656:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.607668:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.607677:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18c00, rc 0) 00000100:00100000:2.0:1788875072.607743:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217951744:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 157us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.607750:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00100000:3.0:1788875072.611535:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875072.611628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217951872 00000100:00100000:0.0:1788875072.611639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217951872 00000100:00100000:0.0:1788875072.611734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:0.0:1788875072.611745:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217951872:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875072.612852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217951872:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 1099us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875072.612863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:1.0:1788875072.620579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875072.620642:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952000 00000100:00100000:1.0:1788875072.620650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952000 00000100:00100000:1.0:1788875072.620699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 235 00000100:00100000:1.0:1788875072.620709:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217952000:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.620981:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217952000:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 272us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875072.621137:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 235 00000100:00100000:3.0:1788875072.626470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875072.626561:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952128 00000100:00100000:1.0:1788875072.626572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952128 00000100:00100000:1.0:1788875072.626634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 236 00000100:00100000:1.0:1788875072.626644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217952128:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875072.626663:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875072.626683:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0adb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.626714:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.626727:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.626736:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26600, rc 0) 00000100:00100000:1.0:1788875072.627023:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217952128:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 380us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875072.627031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 236 00000100:00100000:0.0:1788875072.632875:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875072.633110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952256 00000100:00100000:3.0:1788875072.633121:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952256 00000100:00100000:3.0:1788875072.633397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:3.0:1788875072.633409:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217952256:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788875072.633910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217952256:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 501us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875072.633920:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:3.0:1788875072.637533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875072.637818:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952384 00000100:00100000:0.0:1788875072.637829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952384 00000100:00100000:0.0:1788875072.637882:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 238 00000100:00100000:0.0:1788875072.637892:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217952384:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875072.638158:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217952384:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 266us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875072.638168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 238 10000000:01000000:0.0:1788875072.655217:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788875072.655226:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5904e88000 from 7 10000000:01000000:0.0:1788875072.655231:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788875072.655286:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875072.655298:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875072.655324:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875072.655354:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a362b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241055872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788875072.655425:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875072.655480:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0333e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.655683:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241055872 00000100:00100000:2.0:1788875072.655691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241055872 00000100:00100000:2.0:1788875072.655741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788875072.655750:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241055872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875072.655792:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875072.655816:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d822fe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.655856:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.655868:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.655877:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:2.0:1788875072.655923:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241055872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.655930:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788875072.656001:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a362b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241055872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875072.656019:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.656029:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875072.656094:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.656122:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875072.656137:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.656149:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056000 00000100:00100000:2.0:1788875072.656153:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056000 00000100:00100000:2.0:1788875072.656174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788875072.656181:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241056000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.656438:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241056000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.656457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788875072.656494:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.656523:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.656562:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875072.656576:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.656588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056128 00000100:00100000:2.0:1788875072.656592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056128 00000100:00100000:2.0:1788875072.656612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788875072.656618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241056128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.656747:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241056128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.656755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788875072.656813:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788875072.668057:0:11239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788875072.668350:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788875072.668373:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875072.668385:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.668398:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875072.668409:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788875072.668412:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a07881000 from 7 10000000:01000000:2.0:1788875072.668415:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788875072.668450:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.668470:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875072.668480:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875072.668506:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.668576:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875072.668626:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788875072.670316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056256 00000100:00100000:3.0:1788875072.670331:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056256 00000100:00100000:3.0:1788875072.670397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788875072.670408:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241056256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788875072.670427:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875072.670450:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8230c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.670479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8230c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.670491:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8230c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.670501:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875072.670583:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875072.670591:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788875072.670705:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875072.670723:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.670734:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875072.671012:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.671050:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875072.671099:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.671199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056384 00000100:00100000:2.0:1788875072.671205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056384 00000100:00100000:2.0:1788875072.671240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788875072.671247:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.671515:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.671523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788875072.671638:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.671671:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.671710:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875072.671733:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.671801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056512 00000100:00100000:2.0:1788875072.671806:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056512 00000100:00100000:2.0:1788875072.671846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788875072.671854:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.672267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 412us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.672274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788875072.672365:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788875072.673347:0:11243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788875072.673543:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788875072.673561:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788875072.673571:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.673584:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875072.673595:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788875072.673598:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06641800 from 7 10000000:01000000:1.0:1788875072.673601:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788875072.673636:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.673653:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.673663:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875072.673685:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.673740:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875072.673799:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082840 going to sleep for 11 seconds 00000100:00100000:3.0:1788875072.674101:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056640 00000100:00100000:3.0:1788875072.674107:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056640 00000100:00100000:3.0:1788875072.674186:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788875072.674197:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788875072.674213:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875072.674228:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8231a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.674253:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8231a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.674264:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8231a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.674272:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:3.0:1788875072.674323:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875072.674337:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788875072.674803:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875072.674829:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875072.674839:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875072.674896:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.674934:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875072.680451:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.680602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056768 00000100:00100000:2.0:1788875072.680612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056768 00000100:00100000:2.0:1788875072.680663:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788875072.680682:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.681041:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.681050:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788875072.681557:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.681609:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875072.681658:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875072.681687:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875072.681734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241056896 00000100:00100000:2.0:1788875072.681740:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241056896 00000100:00100000:2.0:1788875072.681959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788875072.681968:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875072.682284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875072.682292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788875072.682381:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241056896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788875072.686216:0:11245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788875072.686540:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788875072.686560:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788875072.686572:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875072.686586:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875073.293898:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875074.318040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788875074.773717:0:11374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788875074.897676:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875074.897702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241057024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875074.898146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875074.900968:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057024 00000100:00100000:1.0:1788875074.900985:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057024 00000100:00100000:1.0:1788875074.901080:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788875074.901093:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241057024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875074.901137:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875074.901225:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241057024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875074.901232:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788875074.901297:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788875074.901336:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3525b100 x1875771241057024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875074.901357:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241057024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788875075.343345:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875075.357738:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875075.357837:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875075.357883:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875075.357910:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952512 00000100:00100000:2.0:1788875075.357921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952512 00000100:00100000:2.0:1788875075.357982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 248 00000100:00100000:2.0:1788875075.358003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217952512:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875075.358031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952768 00000100:00100000:1.0:1788875075.358035:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952768 00000100:00100000:1.0:1788875075.358083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952640 00000100:00100000:2.0:1788875075.358084:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217952512:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875075.358086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952640 00000100:00100000:2.0:1788875075.358091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 248 00000100:00100000:1.0:1788875075.358107:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1788875075.358114:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217952768:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:2.0:1788875075.358136:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875075.358144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217952768:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875075.358149:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:1.0:1788875075.358153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:2.0:1788875075.358155:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217952640:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875075.358180:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217952640:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875075.358186:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:3.0:1788875075.412701:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241057536:0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.412809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875075.412875:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788875075.412883:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241057152:0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.412914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875075.412936:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241057664:0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.412962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875075.413232:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241057280:0@lo:400:kworker.0 00000100:00100000:0.0:1788875075.413278:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875075.413299:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241057792:0@lo:400:kworker.0 00000100:00100000:0.0:1788875075.413322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875075.413341:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788875075.413347:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241057408:0@lo:400:kworker.0 00000100:00100000:0.0:1788875075.413370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875075.413405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057152 00000100:00100000:0.0:1788875075.413412:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057152 00000100:00100000:0.0:1788875075.413458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788875075.413467:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241057152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875075.413589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057664 00000100:00100000:1.0:1788875075.413595:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057664 00000100:00100000:2.0:1788875075.413689:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057536 00000100:00100000:2.0:1788875075.413694:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057536 00000100:00100000:2.0:1788875075.413722:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057792 00000100:00100000:2.0:1788875075.413725:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057792 00000100:00100000:2.0:1788875075.413746:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788875075.413754:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241057536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875075.419200:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241057152:12345-0@lo:400:kworker.0 Request processed in 5722us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875075.419215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788875075.419966:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057280 00000100:00100000:1.0:1788875075.419976:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057280 00000100:00100000:0.0:1788875075.420388:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788875075.420403:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875075.420485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057408 00000100:00100000:1.0:1788875075.420490:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057408 00000100:00100000:1.0:1788875075.420511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788875075.420520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241057664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875075.421132:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241057536:12345-0@lo:400:kworker.0 Request processed in 7375us (8320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875075.421142:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788875075.421180:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788875075.421186:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875075.421217:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788875075.421226:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241057280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.422424:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241057152:0@lo:400:kworker.0 00010000:00080000:3.0:1788875075.422448:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d279c00 x1875771241057536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875075.422462:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241057536:0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.422504:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788875075.422525:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788875075.422583:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788875075.422595:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788875075.422606:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241057408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875075.426953:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241057792:12345-0@lo:400:kworker.0 Request processed in 6544us (13618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875075.426998:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788875075.428650:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d278000 x1875771241057792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875075.428898:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241057792:0@lo:400:kworker.0 00000100:00100000:2.0:1788875075.429390:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241057280:12345-0@lo:400:kworker.0 Request processed in 8162us (16108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875075.429401:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788875075.430352:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241057280:0@lo:400:kworker.0 00000100:00100000:3.0:1788875075.432073:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241057408:12345-0@lo:400:kworker.0 Request processed in 9461us (18692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875075.432087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788875075.432268:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241057408:0@lo:400:kworker.0 00000100:00100000:1.0:1788875075.432455:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241057664:12345-0@lo:400:kworker.0 Request processed in 11934us (19490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875075.432474:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788875075.432532:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241057664:0@lo:400:kworker.0 00000100:00100000:1.0:1788875075.918960:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875075.918988:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241057920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875075.919076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875075.919218:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241057920 00000100:00100000:0.0:1788875075.919227:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241057920 00000100:00100000:0.0:1788875075.919291:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788875075.919301:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241057920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875075.919339:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875075.919391:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241057920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875075.919397:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788875075.920111:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d73480 x1875771241057920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875075.920134:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241057920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875076.366133:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875077.391268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875078.423164:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788875079.309884:0:11475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:44:37 (1788875077) === 00010000:00010000:3.0:1788875079.437928:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875079.596537:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875079.596649:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.597093:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953024 00000100:00100000:0.0:1788875079.597107:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953024 00000100:00100000:2.0:1788875079.597222:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217952896 00000100:00100000:2.0:1788875079.597227:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217952896 00000100:00100000:2.0:1788875079.597286:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1788875079.597297:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2349:x1875771217952896:12345-192.168.202.7@tcp:41:mkdir.0 00000004:00000024:2.0:1788875079.597363:0:8216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875079.597445:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2349:x1875771217952896:12345-192.168.202.7@tcp:41:mkdir.0 Request processed in 149us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875079.597453:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1788875079.597585:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1788875079.597594:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9689:x1875771217953024:12345-192.168.202.7@tcp:700:mkdir.0 00000100:00100000:0.0:1788875079.597633:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9689:x1875771217953024:12345-192.168.202.7@tcp:700:mkdir.0 Request processed in 41us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875079.597640:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00080000:1.0:1788875079.603493:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875079.612503:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.612817:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953280 00000100:00100000:0.0:1788875079.612840:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953280 00000100:00100000:0.0:1788875079.612899:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:0.0:1788875079.612909:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9689:x1875771217953280:12345-192.168.202.7@tcp:36:mkdir.0 00010000:00010000:0.0:1788875079.612969:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875079.613063:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d82209 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a5d expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613087:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:0.0:1788875079.613099:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875079.613433:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613448:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613459:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613487:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613495:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.613502:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875079.614697:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788875079.614711:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614719:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614733:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614740:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00031800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875079.614745:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614755:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614768:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0dd00) 00010000:00010000:0.0:1788875079.614800:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875079.614804:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.614812:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82328 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875079.614829:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0fad6cd reply state 0000000064530749 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875079.614839:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875079.614944:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9689:x1875771217953280:12345-192.168.202.7@tcp:36:mkdir.0 Request processed in 2033us (2448us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788875079.614953:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:0.0:1788875079.617030:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617048:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617070:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617076:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00031a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875079.617080:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617089:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617104:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875079.617106:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875079.617112:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.617118:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8232f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875079.631495:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.632439:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953408 00000100:00100000:1.0:1788875079.632451:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953408 00000100:00100000:1.0:1788875079.632558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1788875079.632569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9690:x1875771217953408:12345-192.168.202.7@tcp:101:chmod.0 00010000:00010000:1.0:1788875079.632593:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875079.632618:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ae2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632708:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632721:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875079.632757:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788875079.632761:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875079.632823:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632848:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae2 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632884:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.632894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875079.632897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875079.632900:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27e00, rc 0) 00000100:00100000:1.0:1788875079.632988:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9690:x1875771217953408:12345-192.168.202.7@tcp:101:chmod.0 Request processed in 421us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875079.632995:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875079.641138:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.641499:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953664 00000100:00100000:2.0:1788875079.641510:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953664 00000100:00100000:2.0:1788875079.641615:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1788875079.641627:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9690:x1875771217953664:12345-192.168.202.7@tcp:36:chmod.0 00010000:00010000:2.0:1788875079.641686:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875079.642504:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8233d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.642530:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:2.0:1788875079.642542:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875079.642569:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.642581:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.642591:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875079.644166:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072237aed reply state 00000000899d37d1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875079.644184:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788875079.644195:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788875079.644314:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:9690:x1875771217953664:12345-192.168.202.7@tcp:36:chmod.0 Request processed in 2687us (3185us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788875079.644345:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00010000:00010000:1.0:1788875079.647682:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647713:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647721:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647727:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.647732:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647740:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647758:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a045baf00) 00010000:00010000:1.0:1788875079.647761:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788875079.647766:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.647826:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82344 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875079.685289:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.686279:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953792 00000100:00100000:0.0:1788875079.686292:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953792 00000100:00100000:0.0:1788875079.686439:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875079.686450:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9691:x1875771217953792:12345-192.168.202.7@tcp:101:chown.0 00010000:00010000:0.0:1788875079.686472:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875079.686496:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8234b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ae9 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686561:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686593:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686606:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875079.686640:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875079.686643:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875079.686695:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686732:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d8234b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae9 expref: 9 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686752:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae9 expref: 8 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.686761:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875079.686765:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875079.686769:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031800, rc 0) 00000100:00100000:0.0:1788875079.686887:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:9691:x1875771217953792:12345-192.168.202.7@tcp:101:chown.0 Request processed in 439us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875079.686896:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1788875079.705214:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.705427:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217953920 00000100:00100000:1.0:1788875079.705438:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217953920 00000100:00100000:1.0:1788875079.705501:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1788875079.705512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:9691:x1875771217953920:12345-192.168.202.7@tcp:101:chown.0 00010000:00010000:1.0:1788875079.705532:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875079.705555:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0af0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705620:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705635:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705646:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705674:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705681:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.705688:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706033:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706063:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875079.706095:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788875079.706099:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875079.706120:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706132:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706139:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706146:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706151:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.706156:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706164:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706176:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:1.0:1788875079.706179:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.706184:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706202:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706217:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706222:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706228:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706232:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.706235:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706241:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706601:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875079.706606:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.706611:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706618:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.706654:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af0 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.707442:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af0 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.707461:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875079.707464:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875079.707467:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26c00, rc 0) 00000100:00100000:1.0:1788875079.707646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:9691:x1875771217953920:12345-192.168.202.7@tcp:101:chown.0 Request processed in 2135us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875079.707663:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875079.714761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.714990:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217954176 00000100:00100000:2.0:1788875079.715000:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217954176 00000100:00100000:2.0:1788875079.715085:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:2.0:1788875079.715092:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:9691:x1875771217954176:12345-192.168.202.7@tcp:36:chown.0 00010000:00010000:2.0:1788875079.715140:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875079.715161:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8236e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af0 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.715177:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:2.0:1788875079.715184:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875079.715205:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.715214:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.715220:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875079.760476:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788875079.760496:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788875079.760531:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6c54f3e reply state 000000008325d3b5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875079.760546:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788875079.760572:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788875079.760705:0:8216:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788875079.760731:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9691:x1875771217954176:12345-192.168.202.7@tcp:36:chown.0 Request processed in 45634us (45974us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788875079.760740:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00010000:00010000:3.0:1788875079.763201:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763217:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763225:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763230:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875079.763314:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763328:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763349:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a045ba600) 00010000:00010000:3.0:1788875079.763352:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788875079.763357:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.763363:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82375 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875079.784629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.785870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217954304 00000100:00100000:2.0:1788875079.785884:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217954304 00000100:00100000:2.0:1788875079.786003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:2.0:1788875079.786024:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9692:x1875771217954304:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:2.0:1788875079.786048:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875079.786072:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d8237c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0af7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788875079.787976:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1829us 00010000:00010000:0.0:1788875079.798963:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.798987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799000:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799028:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799044:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799366:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799384:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875079.799408:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875079.799418:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875079.799459:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799472:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799479:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799486:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799492:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00031a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875079.799496:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799504:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799518:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875079.799521:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875079.799526:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799533:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d82383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799544:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799551:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799567:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799572:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875079.799575:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799582:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799590:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5a0bc0dd00) 00010000:00010000:0.0:1788875079.799593:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875079.799596:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799602:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8238a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d8237c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799676:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af7 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.799684:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:0.0:1788875079.799687:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788875079.799690:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030400, rc 0) 00000100:00100000:0.0:1788875079.799766:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9692:x1875771217954304:12345-192.168.202.7@tcp:101:touch.500 Request processed in 13753us (15187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875079.800905:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875079.806350:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.806404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217954560 00000100:00100000:1.0:1788875079.806415:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217954560 00000100:00100000:1.0:1788875079.806477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:1.0:1788875079.806488:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9692:x1875771217954560:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:1.0:1788875079.806508:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875079.806528:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82398 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0afe expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806814:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806830:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806842:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806864:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.806883:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875079.807688:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788875079.807997:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d823ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808021:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d823ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808030:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d823ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808069:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808076:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808083:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808090:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.808094:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808102:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808114:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:1.0:1788875079.808117:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.808130:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808137:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8239f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875079.808151:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c800b643 reply state 000000001eb90a25 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875079.808160:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788875079.808196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82398 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0afe expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808210:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d823ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0afe expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.808218:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875079.808220:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875079.808223:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27800, rc 0) 00000100:00100000:0.0:1788875079.808519:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:9692:x1875771217954560:12345-192.168.202.7@tcp:101:touch.500 Request processed in 2031us (2178us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788875079.808528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00010000:00010000:3.0:1788875079.810631:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810645:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810653:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810659:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875079.810663:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810671:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810685:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9e5a10bf8d00) 00010000:00010000:3.0:1788875079.810709:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875079.810715:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.810722:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d823a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875079.814193:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.814672:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217954816 00000100:00100000:1.0:1788875079.814683:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217954816 00000100:00100000:1.0:1788875079.814756:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:1.0:1788875079.814768:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:9692:x1875771217954816:12345-192.168.202.7@tcp:36:touch.500 00010000:00010000:1.0:1788875079.814853:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875079.814884:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d823ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0afe expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.814904:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875079.814915:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875079.814987:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.815000:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.815044:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875079.815176:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030b5b829 reply state 00000000ad625345 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875079.815186:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875079.815295:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:9692:x1875771217954816:12345-192.168.202.7@tcp:36:touch.500 Request processed in 528us (1112us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788875079.815303:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00010000:00010000:1.0:1788875079.818324:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818342:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818348:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818354:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.818358:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818366:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818383:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a10bf8400) 00010000:00010000:1.0:1788875079.818400:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.818405:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.818411:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d823bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875079.819434:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.819473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217954944 00000100:00100000:2.0:1788875079.819482:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217954944 00000100:00100000:2.0:1788875079.819539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:2.0:1788875079.819551:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:9692:x1875771217954944:12345-192.168.202.7@tcp:101:touch.500 00010000:00010000:2.0:1788875079.819573:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875079.819593:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d823c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.819944:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d823c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b05 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.819959:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d823c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b05 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.820059:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875079.820063:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875079.820066:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875079.820127:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:9692:x1875771217954944:12345-192.168.202.7@tcp:101:touch.500 Request processed in 579us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875079.820135:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:0.0:1788875079.822830:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875079.823149:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955072 00000100:00100000:3.0:1788875079.823159:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955072 00000100:00100000:3.0:1788875079.823210:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875079.823218:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875771217955072:12345-192.168.202.7@tcp:8:touch.500 00010000:00080000:3.0:1788875079.823252:0:6901:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1788875079.823286:0:6901:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d823c9 00002000:00100000:3.0:1788875079.823298:0:6901:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd989c2b-3da6-48fe-ae0a-99ed44fd91eb/ffff9e5a06242800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788875079.823322:0:6901:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788875079.823554:0:6901:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788875079.823585:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5a06244000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788875079.823656:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217955072:12345-192.168.202.7@tcp:8:touch.500 Request processed in 437us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875079.823663:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875079.829168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.829343:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955200 00000100:00100000:2.0:1788875079.829353:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955200 00000100:00080000:1.0:1788875079.829421:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875079.829426:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:2.0:1788875079.829437:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:0:x1875771217955200:12345-192.168.202.7@tcp:2:touch.500 00000001:00080000:1.0:1788875079.910753:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788875079.910953:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000100:00100000:2.0:1788875079.911476:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:0:x1875771217955200:12345-192.168.202.7@tcp:2:touch.500 Request processed in 82033us (82527us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788875079.911489:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1788875079.914523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.915428:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955456 00000100:00100000:0.0:1788875079.915440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955456 00000100:00100000:0.0:1788875079.915538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1788875079.915549:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:9692:x1875771217955456:12345-192.168.202.7@tcp:35:touch.500 00000100:00100000:0.0:1788875079.915924:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:9692:x1875771217955456:12345-192.168.202.7@tcp:35:touch.500 Request processed in 376us (1410us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788875079.915933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:1.0:1788875079.936762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.937190:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955584 00000100:00100000:0.0:1788875079.937200:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955584 00000100:00100000:0.0:1788875079.937264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1788875079.937275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:9693:x1875771217955584:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:0.0:1788875079.937303:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875079.937463:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d823d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b0c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937556:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937590:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875079.937630:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875079.937634:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875079.937850:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937880:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d823d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b0c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937899:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b0c expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875079.937907:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:0.0:1788875079.937911:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875079.937915:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031a00, rc 0) 00000100:00100000:0.0:1788875079.938444:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:9693:x1875771217955584:12345-192.168.202.7@tcp:101:rm.0 Request processed in 1169us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875079.938452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:2.0:1788875079.945476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875079.945558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955840 00000100:00100000:3.0:1788875079.945568:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955840 00000100:00100000:3.0:1788875079.945672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:3.0:1788875079.945683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:9693:x1875771217955840:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:3.0:1788875079.945711:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875079.945733:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d823de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875079.945872:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788875079.946283:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d823de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b13 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.946298:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:3.0:1788875079.946301:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875079.946306:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d823de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b13 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.946394:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875079.946527:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:9693:x1875771217955840:12345-192.168.202.7@tcp:101:rm.0 Request processed in 845us (1061us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788875079.946535:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:2.0:1788875079.952536:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.952615:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217955968 00000100:00100000:1.0:1788875079.952625:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217955968 00000100:00100000:1.0:1788875079.952686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1788875079.952819:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:9693:x1875771217955968:12345-192.168.202.7@tcp:37:rm.0 00000100:00100000:2.0:1788875079.960282:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:9693:x1875771217955968:12345-192.168.202.7@tcp:37:rm.0 Request processed in 7455us (7742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875079.960295:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1788875079.964569:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875079.964754:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217956224 00000100:00100000:0.0:1788875079.964767:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217956224 00000100:00100000:2.0:1788875079.965156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:2.0:1788875079.965169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:9693:x1875771217956224:12345-192.168.202.7@tcp:35:rm.0 00000100:00100000:2.0:1788875079.965402:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:9693:x1875771217956224:12345-192.168.202.7@tcp:35:rm.0 Request processed in 235us (840us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788875079.965409:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1788875079.969629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.969731:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217956480 00000100:00100000:2.0:1788875079.969740:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217956480 00000100:00100000:2.0:1788875079.969822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1788875079.969833:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:9693:x1875771217956480:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:2.0:1788875079.969858:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875079.969878:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d823ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b1a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.970151:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d823f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.970167:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d823f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.970192:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d823f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875079.970205:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788875079.970335:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d823ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b1a expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.970354:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d823f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b1a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875079.970363:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:2.0:1788875079.970366:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788875079.970370:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18400, rc 0) 00000100:00100000:2.0:1788875079.970440:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217956480:12345-192.168.202.7@tcp:101:rm.0 Request processed in 609us (822us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788875079.970448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1788875079.974267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.974458:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217956608 00000100:00100000:1.0:1788875079.974469:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217956608 00000100:00100000:1.0:1788875079.974531:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:1.0:1788875079.974541:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217956608:12345-192.168.202.7@tcp:41:rm.0 00000004:00000024:1.0:1788875079.974605:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788875079.974700:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217956608:12345-192.168.202.7@tcp:41:rm.0 Request processed in 160us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875079.974709:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1788875079.978423:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.978544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217956736 00000100:00100000:1.0:1788875079.978555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217956736 00000100:00100000:1.0:1788875079.978618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:1.0:1788875079.978629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217956736:12345-192.168.202.7@tcp:101:rm.0 00010000:00010000:1.0:1788875079.978680:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875079.978715:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82401 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b21 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978815:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978829:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978841:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978864:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978871:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.978996:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979018:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979028:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875079.979056:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788875079.979066:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875079.979087:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979099:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979108:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979115:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979121:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979128:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.979132:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979140:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979152:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:1.0:1788875079.979155:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.979160:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979167:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979181:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979197:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979203:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979208:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.979211:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979217:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979224:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875079.979227:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.979229:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979235:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d8240f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d82401 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b21 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979278:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b21 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.979286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875079.979288:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875079.979296:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26800, rc 0) 00000100:00100000:1.0:1788875079.979352:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:9693:x1875771217956736:12345-192.168.202.7@tcp:101:rm.0 Request processed in 725us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875079.979359:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:3.0:1788875079.988409:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875079.988513:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217956992 00000100:00100000:1.0:1788875079.988524:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217956992 00000100:00100000:1.0:1788875079.988595:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1788875079.988607:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:9693:x1875771217956992:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:1.0:1788875079.988669:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788875079.988695:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d82416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b21 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988718:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d823c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b05 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988729:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875079.988744:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031a00/0x60858e6020d823d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b0c expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988755:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:1.0:1788875079.988758:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875079.988819:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988833:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988842:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988878:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988885:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.988891:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989027:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989036:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989043:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788875079.989768:0:8216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788875079.989805:0:8216:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294855032142ns, next at 295855028652ns, rc = 0 00010000:00010000:1.0:1788875079.989877:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989887:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989895:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989902:0:8216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989918:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989925:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989959:0:8216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875079.989980:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989987:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989993:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.989998:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.990002:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990020:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990029:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a10bf8400) 00010000:00010000:1.0:1788875079.990032:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788875079.990036:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990041:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d8242b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990058:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990069:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990074:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990080:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875079.990082:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990088:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990096:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:1.0:1788875079.990098:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875079.990101:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875079.990106:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d8241d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875079.990117:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dc97a62 reply state 000000003b95dcb9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875079.990126:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875079.990211:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217956992:12345-192.168.202.7@tcp:36:rm.0 Request processed in 1603us (1810us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788875079.990220:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00010000:00010000:3.0:1788875079.991130:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875079.991139:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.991147:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875079.991150:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.991159:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.991171:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e5a10bf8400) 00010000:00010000:3.0:1788875079.991183:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788875079.991188:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.991193:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d82432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.991210:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875079.991212:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875079.991214:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875079.994944:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.994973:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.994981:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.994988:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875079.994992:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.995000:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.995028:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff9e5a10bf8200) 00010000:00010000:3.0:1788875079.995032:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875079.995036:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875079.995043:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82424 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875079.997755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875079.998270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217957248 00000100:00100000:2.0:1788875079.998282:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217957248 00000100:00100000:2.0:1788875079.998434:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1788875079.998446:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:9693:x1875771217957248:12345-192.168.202.7@tcp:35:rm.0 00000100:00100000:2.0:1788875079.998683:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217957248:12345-192.168.202.7@tcp:35:rm.0 Request processed in 239us (939us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788875079.998690:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:0.0:1788875080.003281:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875080.003480:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217957504 00000100:00100000:2.0:1788875080.003491:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217957504 00000100:00100000:2.0:1788875080.003605:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:2.0:1788875080.003617:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:9693:x1875771217957504:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:2.0:1788875080.003693:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788875080.003721:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d823f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b1a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.003743:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d82391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0af7 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.003756:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a0bc0d400) 00010000:00010000:2.0:1788875080.003943:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00031800/0x60858e6020d82352 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ae9 expref: 14 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004037:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875080.004047:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875080.004073:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004086:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004096:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004108:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004115:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.004132:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.005291:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.005303:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.005379:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875080.006702:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788875080.006720:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.006729:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.006736:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.006743:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875080.006748:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.006755:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.006769:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:2.0:1788875080.007095:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788875080.007109:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007115:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19800/0x60858e6020d82447 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007141:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007147:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007153:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007159:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875080.007162:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007168:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007176:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a045ba200) 00010000:00010000:2.0:1788875080.007179:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875080.007182:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875080.007188:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d82439 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875080.007201:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffdd8f42 reply state 00000000e5ae791a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875080.007221:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875080.007430:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:9693:x1875771217957504:12345-192.168.202.7@tcp:36:rm.0 Request processed in 3810us (4154us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788875080.007439:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00010000:00010000:1.0:1788875080.011062:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011097:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011105:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011111:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875080.011116:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011125:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011142:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875080.011145:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875080.011150:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875080.011157:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82440 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875080.016538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788875080.016564:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241058048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875080.016645:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875080.017144:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058048 00000100:00100000:2.0:1788875080.017154:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058048 00000100:00100000:2.0:1788875080.017222:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788875080.017234:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241058048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875080.017256:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875080.017306:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241058048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875080.017327:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788875080.017451:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788875080.017488:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a35970a80 x1875771241058048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875080.017509:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241058048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788875080.462288:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875080.488623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875080.488677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875080.488729:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875080.488802:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217957760 00000100:00100000:1.0:1788875080.488827:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217957760 00000100:00100000:1.0:1788875080.488893:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:1.0:1788875080.488904:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217957760:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875080.488947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217957632 00000100:00100000:3.0:1788875080.488952:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217957632 00000100:00100000:1.0:1788875080.488974:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217957760:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875080.488977:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 250 00000100:00100000:1.0:1788875080.488983:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875080.488984:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217957632:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875080.489023:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217957632:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 39us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875080.489030:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 250 00000100:00100000:2.0:1788875080.489067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217957888 00000100:00100000:2.0:1788875080.489071:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217957888 00000100:00100000:2.0:1788875080.489123:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:2.0:1788875080.489131:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217957888:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875080.489163:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217957888:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875080.489169:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00080000:1.0:1788875080.489227:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875080.527738:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241058304:0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.527833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875080.527907:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241058816:0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.527933:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875080.527978:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875080.527985:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241058432:0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.528020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875080.528050:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058816 00000100:00100000:3.0:1788875080.528057:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058816 00000100:00100000:3.0:1788875080.528107:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788875080.528115:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241058816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.528167:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241058816:12345-0@lo:400:kworker.0 Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875080.528174:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788875080.528213:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d035880 x1875771241058816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875080.528227:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241058816:0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.528495:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241058560:0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.528527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875080.528565:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788875080.528571:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241058176:0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.528600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875080.528622:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241058688:0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.528645:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875080.528665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058176 00000100:00100000:0.0:1788875080.528668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058176 00000100:00100000:0.0:1788875080.528691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788875080.528698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241058176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.528729:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241058176:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875080.528734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788875080.528764:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241058176:0@lo:400:kworker.0 00000100:00100000:2.0:1788875080.528930:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058560 00000100:00100000:2.0:1788875080.528934:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058560 00000100:00100000:2.0:1788875080.528977:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788875080.528985:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241058560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875080.529036:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241058560:12345-0@lo:400:kworker.0 Request processed in 52us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875080.529048:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788875080.529072:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d034700 x1875771241058560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875080.529082:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788875080.529100:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058304 00000100:00100000:2.0:1788875080.529104:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058304 00000100:00100000:2.0:1788875080.529125:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058432 00000100:00100000:2.0:1788875080.529128:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058432 00000100:00100000:2.0:1788875080.529147:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058688 00000100:00100000:2.0:1788875080.529149:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058688 00000100:00100000:2.0:1788875080.529164:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788875080.529170:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241058304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875080.529207:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241058304:12345-0@lo:400:kworker.0 Request processed in 37us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875080.529213:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788875080.529224:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788875080.529230:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241058432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875080.529449:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788875080.529459:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241058688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.529553:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241058432:0@lo:400:kworker.0 00000100:00100000:3.0:1788875080.529565:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241058304:0@lo:400:kworker.0 00000100:00080000:1.0:1788875080.529655:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788875080.529671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875080.534791:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241058688:12345-0@lo:400:kworker.0 Request processed in 5303us (6113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875080.534808:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788875080.534911:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241058432:12345-0@lo:400:kworker.0 Request processed in 5679us (6887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875080.534920:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788875080.535097:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241058688:0@lo:400:kworker.0 00000100:00100000:3.0:1788875081.038022:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875081.038048:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241058944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875081.038121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875081.038289:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241058944 00000100:00100000:2.0:1788875081.038297:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241058944 00000100:00100000:2.0:1788875081.038352:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788875081.038362:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241058944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875081.038398:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875081.038455:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241058944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875081.038474:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788875081.038613:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5905d73480 x1875771241058944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875081.038631:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241058944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875081.488447:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875082.515521:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875083.534588:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875083.983660:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788875084.558078:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788875084.978601:0:11673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbb6fea50 20000000:00000080:1.0:1788875084.978619:0:11673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a3d382000 uarg=0000000000000000 20000000:01000000:1.0:1788875084.978657:0:11673:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788875084.978664:0:11673:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788875084.978669:0:11673:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788875084.987318:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788875084.987549:0:11673:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788875084.998337:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788875084.998399:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788875084.998458:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788875084.998477:0:11673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788875084.998495:0:11673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998515:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998535:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998542:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d822fe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998549:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8230c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998555:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8231a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998563:0:11673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998605:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998620:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 18 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875084.998634:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059072:0@lo:104: 00000100:00100000:0.0:1788875084.998701:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788875084.998842:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875084.998851:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 18 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875084.998870:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059200:0@lo:104: 00000100:00100000:0.0:1788875084.998893:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788875085.004845:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.004865:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 18 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.004881:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059328:0@lo:104: 00000100:00100000:0.0:1788875085.004944:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875085.005070:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059072 00000100:00100000:3.0:1788875085.005079:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059072 00000100:00100000:2.0:1788875085.005920:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059200 00000100:00100000:2.0:1788875085.005928:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059200 00000100:00100000:2.0:1788875085.005969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875085.005978:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:11673:x1875771241059072:12345-0@lo:104: 00010000:00010000:2.0:1788875085.005994:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006060:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788875085.006067:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+4:11673:x1875771241059072:12345-0@lo:104: Request processed in 91us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875085.006073:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788875085.006091:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788875085.006097:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11673:x1875771241059200:12345-0@lo:104: 00010000:00010000:2.0:1788875085.006106:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006139:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788875085.006144:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:372e367e-0deb-4060-9f2e-265b56425d5a+3:11673:x1875771241059200:12345-0@lo:104: Request processed in 48us (7251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875085.006150:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788875085.006171:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875085.006177:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006183:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875085.006188:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006214:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875085.006221:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875085.006226:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875085.006260:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006266:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788875085.006285:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006293:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27200/0x60858e6020d8231a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82321 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006307:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875085.006309:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006314:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875085.006317:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006323:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875085.006329:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875085.006340:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875085.006355:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006360:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788875085.006365:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006371:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18a00/0x60858e6020d8230c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82313 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.006379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875085.006381:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875085.006382:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875085.006389:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875085.006408:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241059456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875085.006440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875085.006477:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875085.006484:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241059584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875085.006505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875085.006880:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059456 00000100:00100000:2.0:1788875085.006886:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059456 00010000:00010000:2.0:1788875085.006909:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 19 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875085.006939:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059584 00000100:00100000:2.0:1788875085.006942:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059584 00010000:00010000:2.0:1788875085.006952:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 20 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875085.006994:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788875085.007002:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+20:3305:x1875771241059456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875085.007014:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875085.007020:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 20 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.007031:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 20 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.007049:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875085.007083:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+20:3305:x1875771241059456:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875085.007090:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788875085.007104:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788875085.007110:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241059584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875085.007117:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875085.007121:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 19 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.007130:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 19 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.007139:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875085.007159:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241059584:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875085.007166:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788875085.007203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241059584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875085.007221:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241059456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788875085.007450:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.007464:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 12 pid: 5833 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.007474:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059712:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875085.007541:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.007550:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.007558:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059840:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875085.007584:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a373c9180 going to sleep for 10 seconds 00010000:00010000:0.0:1788875085.007599:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15200/0x60858e6020d82321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8231a expref: 18 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.007620:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059072:0@lo:104: 00010000:00010000:0.0:1788875085.007632:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14400/0x60858e6020d82313 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d8230c expref: 17 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.007640:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059200:0@lo:104: 00000100:00100000:3.0:1788875085.007886:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788875085.007899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059328 00000100:00100000:3.0:1788875085.007903:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059328 00000100:00100000:3.0:1788875085.007925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788875085.007932:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c50ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:11673:x1875771241059328:12345-0@lo:104: 00010000:00010000:3.0:1788875085.007943:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875085.008036:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788875085.008041:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c50ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:372e367e-0deb-4060-9f2e-265b56425d5a+3:11673:x1875771241059328:12345-0@lo:104: Request processed in 110us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875085.008048:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788875085.008252:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059328:0@lo:104: 00010000:00010000:2.0:1788875085.008289:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875085.008295:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.008301:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875085.008305:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.008312:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875085.008319:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875085.008324:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875085.008387:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.008393:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788875085.008437:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241059968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875085.008471:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788875085.008623:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.008632:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a00030800/0x60858e6020d822fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d82305 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875085.008649:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875085.008650:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875085.008652:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875085.008732:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241059968 00000100:00100000:0.0:1788875085.008737:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241059968 00010000:00010000:0.0:1788875085.008757:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.008807:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788875085.008814:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+17:3303:x1875771241059968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788875085.008824:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875085.008828:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.008836:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.008849:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a19000/0x60858e6020d82305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d822fe expref: 17 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.008859:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875085.009047:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+16:3303:x1875771241059968:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.009054:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788875085.009135:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241059968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875085.013199:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059712:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875085.017582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875085.017736:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1875771241059840:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875085.017804:0:11673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875085.020695:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958016 00000100:00100000:1.0:1788875085.020711:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958016 00010000:00010000:1.0:1788875085.020809:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875085.020852:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:1.0:1788875085.020863:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217958016:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875085.020894:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875085.020901:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.020913:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.020931:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26600/0x60858e6020d822f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0adb expref: 13 pid: 5833 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.020948:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875085.021033:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+12:2348:x1875771217958016:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 171us (3462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875085.021041:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:3.0:1788875085.021164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875085.021219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958144 00000100:00100000:0.0:1788875085.021225:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958144 00010000:00010000:0.0:1788875085.021243:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875085.021270:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:0.0:1788875085.021277:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+12:2348:x1875771217958144:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875085.021286:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875085.021291:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021300:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021310:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18c00/0x60858e6020d822f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ad4 expref: 12 pid: 5834 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021321:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021330:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021345:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021352:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021358:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021371:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021377:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00031a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875085.021382:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021390:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021415:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875085.021425:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875085.021452:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f85827f-e9c9-452e-88ac-d3df48643465+11:2348:x1875771217958144:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 176us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.021460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00010000:00010000:3.0:1788875085.022037:0:11673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875085.022049:0:11673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875085.022055:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031a00/0x60858e6020d8244e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875085.138688:0:6900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300003913429ns, next at 301003911374ns, rc = 0 00000100:00100000:1.0:1788875085.138744:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241060096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875085.138828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875085.138908:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060096 00000100:00100000:1.0:1788875085.138915:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060096 00000100:00100000:1.0:1788875085.138974:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788875085.138985:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241060096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875085.139017:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875085.139061:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241060096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875085.139068:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788875085.139236:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788875085.139265:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d036300 x1875771241060096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875085.139290:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241060096:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788875085.184537:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:0.0:1788875085.184550:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1788875085.184553:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788875085.184604:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788875085.184979:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241060224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788875085.185052:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875085.185136:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060224 00000100:00100000:1.0:1788875085.185144:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060224 00000100:00100000:1.0:1788875085.185193:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788875085.185202:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241060224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788875085.185225:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788875085.185258:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa01148, atime: 0x6aa01148, ctime: 0x6aa01148, blocks: 0x1 00010000:00010000:1.0:1788875085.185265:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.185279:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:1.0:1788875085.185284:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875085.185290:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.185306:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.185317:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.185325:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.185342:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788875085.186197:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241060224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 992us (1141us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788875085.186206:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788875085.186232:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875085.186239:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.186247:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875085.186251:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.186261:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.186279:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.186287:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000723cdb40/0x60858e6020d82455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875085.186302:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875085.186303:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875085.186305:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788875085.186356:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a35973100/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788875085.186363:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241060224:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788875085.582001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875085.597188:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875085.597224:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875085.597257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875085.597260:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958400 00000100:00100000:0.0:1788875085.597269:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958400 00000100:00100000:1.0:1788875085.597357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958272 00000100:00100000:1.0:1788875085.597361:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958272 00000100:00100000:2.0:1788875085.597394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958528 00000100:00100000:2.0:1788875085.597398:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958528 00000100:00100000:1.0:1788875085.597401:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:1.0:1788875085.597411:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217958272:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875085.597423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:2.0:1788875085.597428:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217958528:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875085.597493:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:1.0:1788875085.597502:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217958272:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.597507:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217958400:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875085.597510:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00080000:1.0:1788875085.597532:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788875085.597537:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875085.597660:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771217958528:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 230us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875085.597666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:0.0:1788875085.599111:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217958400:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1597us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.599125:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:1.0:1788875085.646055:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241060608:0@lo:400:kworker.0 00000100:00100000:3.0:1788875085.646058:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241060480:0@lo:400:kworker.0 00000100:00100000:2.0:1788875085.646126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241060352:0@lo:400:kworker.0 00000100:00100000:0.0:1788875085.646174:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241060736:0@lo:400:kworker.0 00000100:00100000:3.0:1788875085.646197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875085.646216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875085.646270:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060480 00000100:00100000:3.0:1788875085.646278:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060480 00000100:00100000:0.0:1788875085.646278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060736 00000100:00100000:0.0:1788875085.646281:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060736 00000100:00100000:0.0:1788875085.646324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788875085.646333:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241060736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875085.646350:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788875085.646356:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875085.646383:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241060480:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.646383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241060736:12345-0@lo:400:kworker.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875085.646389:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788875085.646392:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788875085.646411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875085.646430:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241060480:0@lo:400:kworker.0 00000100:00100000:0.0:1788875085.646430:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241060736:0@lo:400:kworker.0 00000100:00100000:1.0:1788875085.649555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875085.652028:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060608 00000100:00100000:3.0:1788875085.652044:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060608 00000100:00100000:3.0:1788875085.652141:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788875085.652152:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241060608:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788875085.652172:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875085.652256:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241060608:12345-0@lo:400:kworker.0 Request processed in 105us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875085.652275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788875085.652518:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241060608:0@lo:400:kworker.0 00000100:00100000:2.0:1788875085.653083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875085.653178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241060864:0@lo:400:kworker.0 00000100:00100000:2.0:1788875085.653210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875085.653381:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060864 00000100:00100000:3.0:1788875085.653387:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060864 00000100:00100000:3.0:1788875085.653437:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788875085.653445:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875085.653489:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241060864:12345-0@lo:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875085.653495:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788875085.653525:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d037b80 x1875771241060864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875085.653537:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241060864:0@lo:400:kworker.0 00000100:00080000:1.0:1788875085.653729:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875085.653874:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060352 00000100:00100000:0.0:1788875085.653878:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060352 00000100:00100000:0.0:1788875085.654018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788875085.654027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:3306:x1875771241060352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875085.654075:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+16:3306:x1875771241060352:12345-0@lo:400:kworker.0 Request processed in 50us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875085.654082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788875085.654144:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788875086.158174:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241060992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875086.158247:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.158367:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241060992 00000100:00100000:0.0:1788875086.158388:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241060992 00000100:00100000:0.0:1788875086.158440:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788875086.158458:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241060992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875086.158491:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875086.158533:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241060992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.158540:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788875086.158663:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58d880 x1875771241060992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875086.158681:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241060992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875086.172413:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875086.172553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958656 00000100:00100000:3.0:1788875086.172564:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958656 00000100:00100000:3.0:1788875086.172631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 253 00000100:00100000:3.0:1788875086.172650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+11:5593:x1875771217958656:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788875086.172667:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875086.172685:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14800/0x60858e6020d8245c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b28 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875086.172944:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14800/0x60858e6020d8245c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b28 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875086.172965:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14800/0x60858e6020d8245c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b28 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875086.172974:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14800, rc 0) 00000100:00100000:3.0:1788875086.173040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217958656:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 399us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875086.173047:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 253 00000100:00100000:1.0:1788875086.182908:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.183026:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958784 00000100:00100000:0.0:1788875086.183037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958784 00000100:00100000:0.0:1788875086.183096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 254 00000100:00100000:0.0:1788875086.183106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217958784:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.183598:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217958784:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 492us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.183607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 254 00000100:00100000:0.0:1788875086.186375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875086.186471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217958912 00000100:00100000:3.0:1788875086.186480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217958912 00000100:00100000:3.0:1788875086.186535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 255 00000100:00100000:3.0:1788875086.186545:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217958912:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875086.186836:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217958912:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 291us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875086.186846:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 255 00000100:00100000:1.0:1788875086.200338:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.200458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959040 00000100:00100000:0.0:1788875086.200474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959040 00000100:00100000:0.0:1788875086.200552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 256 00000100:00100000:0.0:1788875086.200563:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:9965:x1875771217959040:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788875086.200870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:9965:x1875771217959040:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 308us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.200880:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 256 00000100:00100000:3.0:1788875086.206476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.206571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959168 00000100:00100000:0.0:1788875086.206584:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959168 00000100:00100000:0.0:1788875086.206674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 257 00000100:00100000:0.0:1788875086.206686:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:9965:x1875771217959168:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788875086.207577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+12:9965:x1875771217959168:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 886us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.207588:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 257 00000100:00100000:3.0:1788875086.222240:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.222507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959296 00000100:00100000:0.0:1788875086.222521:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959296 00000100:00100000:0.0:1788875086.222592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 258 00000100:00100000:0.0:1788875086.222603:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+12:5593:x1875771217959296:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875086.222624:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875086.222660:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00031400/0x60858e6020d82463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b2f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.222702:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00031400/0x60858e6020d82463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b2f expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.222721:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00031400/0x60858e6020d82463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b2f expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.222732:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031400, rc 0) 00000100:00100000:0.0:1788875086.222834:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217959296:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 232us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.222842:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 258 00000100:00100000:1.0:1788875086.233529:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.235035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959424 00000100:00100000:0.0:1788875086.235052:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959424 00000100:00100000:0.0:1788875086.235134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 259 00000100:00100000:0.0:1788875086.235144:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217959424:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.235501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217959424:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 357us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.235517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 259 00000100:00100000:1.0:1788875086.240312:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875086.240441:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959552 00000100:00100000:2.0:1788875086.240454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959552 00000100:00100000:2.0:1788875086.240524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 260 00000100:00100000:2.0:1788875086.240537:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217959552:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.240927:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:5593:x1875771217959552:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 392us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.240937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 260 00000100:00100000:3.0:1788875086.248450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875086.249369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959680 00000100:00100000:2.0:1788875086.249398:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959680 00000100:00100000:2.0:1788875086.249469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 261 00000100:00100000:2.0:1788875086.249480:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:9968:x1875771217959680:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875086.249848:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:9968:x1875771217959680:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 367us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.249865:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 261 00000100:00100000:1.0:1788875086.252283:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875086.252414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959808 00000100:00100000:0.0:1788875086.252427:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959808 00000100:00100000:0.0:1788875086.252496:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 262 00000100:00100000:0.0:1788875086.252507:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:9968:x1875771217959808:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788875086.259817:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:9968:x1875771217959808:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 7295us (7532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875086.259837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 262 00010000:00010000:0.0:1788875086.606307:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788875086.606363:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788875086.606370:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5904e88000 from 7 10000000:01000000:2.0:1788875086.606377:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788875086.606449:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.606464:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.606479:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875086.606516:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.606637:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.606769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061120 00000100:00100000:0.0:1788875086.606806:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061120 00000100:00100000:0.0:1788875086.606873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788875086.606883:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+16:5838:x1875771241061120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875086.606902:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875086.606932:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a00031800/0x60858e6020d82471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8246a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.606975:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a00031800/0x60858e6020d82471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8246a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.606988:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a00031800/0x60858e6020d82471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8246a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.607000:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00031800, rc 0) 00000100:00100000:0.0:1788875086.607043:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875086.607052:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788875086.607836:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.607878:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875086.607901:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.607913:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875086.608009:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.608075:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875086.608169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061248 00000100:00100000:3.0:1788875086.608176:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061248 00000100:00100000:3.0:1788875086.608224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788875086.608233:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788875086.608578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875086.608594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788875086.620188:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.620259:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.620354:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.620469:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875086.620515:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788875086.621888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061376 00000100:00100000:3.0:1788875086.621907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061376 00000100:00100000:3.0:1788875086.622028:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788875086.622039:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875086.622360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875086.622370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788875086.622593:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.632171:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11687:1875771241061504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875086.632309:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.632383:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84900 going to sleep for 11 seconds 00000100:00100000:1.0:1788875086.632470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061504 00000100:00100000:1.0:1788875086.632480:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061504 00000100:00100000:1.0:1788875086.632548:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788875086.632559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:11687:x1875771241061504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875086.632963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+17:11687:x1875771241061504:12345-0@lo:502:llog_process_th.0 Request processed in 403us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875086.632972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788875086.633497:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11687:1875771241061504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875086.633546:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875086.633560:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875086.633563:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788875086.633572:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5904e88000 00000020:00000080:0.0:1788875086.633574:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788875086.633697:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11687:1875771241061632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875086.633758:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.633842:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.634232:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061632 00000100:00100000:2.0:1788875086.634240:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061632 00000100:00100000:2.0:1788875086.634302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788875086.634312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:11687:x1875771241061632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875086.634559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:11687:x1875771241061632:12345-0@lo:502:llog_process_th.0 Request processed in 247us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.634567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788875086.635964:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11687:1875771241061632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875086.636022:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875086.636033:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875086.636035:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788875086.636041:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788875086.636739:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788875086.636832:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875086.636848:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.636861:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875086.636874:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788875086.636877:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a07881000 from 7 10000000:01000000:2.0:1788875086.636880:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788875086.636925:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.636964:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.636976:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875086.637006:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.637088:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875086.637134:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.637156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061760 00000100:00100000:2.0:1788875086.637164:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061760 00000100:00100000:2.0:1788875086.637218:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788875086.637228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+17:5838:x1875771241061760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875086.637245:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875086.637261:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18400/0x60858e6020d8247f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82478 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.637294:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18400/0x60858e6020d8247f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82478 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.637308:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18400/0x60858e6020d8247f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82478 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.637319:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18400, rc 0) 00000100:00100000:2.0:1788875086.637360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241061760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.637368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788875086.637424:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875086.637439:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.637449:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875086.637503:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.637529:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875086.637542:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.637552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241061888 00000100:00100000:2.0:1788875086.637556:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241061888 00000100:00100000:2.0:1788875086.637573:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788875086.637578:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241061888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.637929:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241061888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.637937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788875086.637978:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.638008:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.638049:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875086.638063:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.638075:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062016 00000100:00100000:2.0:1788875086.638079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062016 00000100:00100000:2.0:1788875086.638097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788875086.638103:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241062016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.638261:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241062016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.638275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788875086.638314:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875086.661018:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11688:1875771241062144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788875086.661148:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875086.661213:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.667119:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062144 00000100:00100000:2.0:1788875086.667144:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062144 00000100:00100000:2.0:1788875086.667236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788875086.667250:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:11688:x1875771241062144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875086.667613:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:11688:x1875771241062144:12345-0@lo:502:llog_process_th.0 Request processed in 364us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.667622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788875086.667835:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11688:1875771241062144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788875086.667884:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788875086.667898:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875086.667901:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788875086.667910:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5a07881000 00000020:00000080:3.0:1788875086.667924:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788875086.668057:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11688:1875771241062272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788875086.668114:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875086.668151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062272 00000100:00100000:3.0:1788875086.668157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062272 00000100:00100000:3.0:1788875086.668187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788875086.668194:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:11688:x1875771241062272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788875086.668341:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+18:11688:x1875771241062272:12345-0@lo:502:llog_process_th.0 Request processed in 145us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875086.668357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788875086.668404:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788875086.668417:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11688:1875771241062272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788875086.668435:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788875086.668440:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875086.668441:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788875086.668445:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788875086.668609:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788875086.668644:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788875086.668659:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.668671:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875086.668684:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788875086.668687:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06641800 from 7 10000000:01000000:0.0:1788875086.668691:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788875086.668724:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.668733:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.668752:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875086.668916:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.668963:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.668982:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.669148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062400 00000100:00100000:2.0:1788875086.669155:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062400 00000100:00100000:2.0:1788875086.669190:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788875086.669199:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+18:5838:x1875771241062400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875086.669212:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875086.669227:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18600/0x60858e6020d8248d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d82486 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.669256:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18600/0x60858e6020d8248d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d82486 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.669269:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18600/0x60858e6020d8248d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d82486 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875086.669280:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18600, rc 0) 00000100:00100000:2.0:1788875086.669324:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241062400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.669354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788875086.670272:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875086.670298:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875086.670312:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875086.670397:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.670460:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.670502:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.672597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062528 00000100:00100000:2.0:1788875086.672619:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062528 00000100:00100000:2.0:1788875086.672712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788875086.672725:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241062528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875086.673191:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241062528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.673201:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788875086.673997:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.674069:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.674129:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.674181:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84180 going to sleep for 11 seconds 00000100:00100000:1.0:1788875086.679886:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062656 00000100:00100000:1.0:1788875086.679920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062656 00000100:00100000:1.0:1788875086.680014:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788875086.680028:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241062656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875086.680389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:5838:x1875771241062656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 363us (6258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875086.680398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788875086.680435:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:372e367e-0deb-4060-9f2e-265b56425d5a:5838:1875771241062656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875086.680976:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11691:1875771241062784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875086.681038:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.681089:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.681841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062784 00000100:00100000:2.0:1788875086.681852:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062784 00000100:00100000:2.0:1788875086.681906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788875086.681916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:11691:x1875771241062784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875086.682197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:11691:x1875771241062784:12345-0@lo:502:llog_process_th.0 Request processed in 282us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.682205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788875086.682560:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11691:1875771241062784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875086.682604:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875086.682616:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875086.682619:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788875086.682641:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5a06641800 00000020:00000080:0.0:1788875086.682644:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788875086.682763:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11691:1875771241062912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875086.682852:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875086.682890:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a07b84900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875086.683315:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241062912 00000100:00100000:2.0:1788875086.683322:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241062912 00000100:00100000:2.0:1788875086.683389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788875086.683400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:11691:x1875771241062912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875086.683638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:11691:x1875771241062912:12345-0@lo:502:llog_process_th.0 Request processed in 239us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875086.683646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788875086.684176:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:372e367e-0deb-4060-9f2e-265b56425d5a:11691:1875771241062912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875086.684222:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875086.684231:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875086.684234:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788875086.684240:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788875086.687146:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788875086.687192:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788875086.687210:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875086.687227:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875086.696970:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788875087.630522:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788875087.758836:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788875088.654938:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875089.679212:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875090.256700:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875090.256723:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241063040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875090.256813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875090.256886:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063040 00000100:00100000:2.0:1788875090.256894:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063040 00000100:00100000:2.0:1788875090.256979:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788875090.256988:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241063040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875090.257028:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875090.257075:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241063040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875090.257083:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788875090.257220:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875090.257406:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241063040:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788875090.270257:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788875090.338993:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788875090.702117:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875090.716600:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875090.716633:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875090.716674:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875090.716714:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875090.716750:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960192 00000100:00100000:1.0:1788875090.716759:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960192 00000100:00100000:0.0:1788875090.716959:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960064 00000100:00100000:0.0:1788875090.716964:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960064 00000100:00100000:1.0:1788875090.717051:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:1.0:1788875090.717063:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217960192:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875090.717135:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217960192:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 74us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875090.717142:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875090.717217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217959936 00000100:00100000:2.0:1788875090.717221:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217959936 00000100:00100000:2.0:1788875090.717251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 278 00000100:00100000:2.0:1788875090.717257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217959936:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875090.717284:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217959936:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875090.717290:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 278 00000100:00100000:3.0:1788875090.717681:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960320 00000100:00100000:3.0:1788875090.717686:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960320 00000100:00100000:0.0:1788875090.721224:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:0.0:1788875090.721242:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217960064:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875090.721336:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771217960064:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 99us (4763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875090.721342:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00080000:1.0:1788875090.721992:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788875090.722001:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875090.722608:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:3.0:1788875090.722620:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217960320:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875090.722695:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217960320:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 78us (6061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875090.722702:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:3.0:1788875090.766328:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241063296:0@lo:400:kworker.0 00000100:00100000:3.0:1788875090.766407:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875090.766479:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788875090.766486:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241063168:0@lo:400:kworker.0 00000100:00100000:3.0:1788875090.766517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875090.766537:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241063680:0@lo:400:kworker.0 00000100:00100000:3.0:1788875090.766579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875090.766610:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063680 00000100:00100000:3.0:1788875090.766617:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063680 00000100:00100000:3.0:1788875090.766667:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788875090.766676:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241063680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875090.766725:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241063680:12345-0@lo:400:kworker.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875090.766732:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788875090.766765:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58d880 x1875771241063680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875090.766814:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241063680:0@lo:400:kworker.0 00000100:00100000:2.0:1788875090.766950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063168 00000100:00100000:2.0:1788875090.766955:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063168 00000100:00100000:2.0:1788875090.766992:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788875090.766999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241063168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875090.767038:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241063168:12345-0@lo:400:kworker.0 Request processed in 40us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875090.767045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788875090.767077:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767145:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241063552:0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767182:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875090.767210:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875090.767215:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875090.767260:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063296 00000100:00100000:1.0:1788875090.767264:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063296 00000100:00100000:1.0:1788875090.767286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063552 00000100:00100000:1.0:1788875090.767289:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063552 00000100:00100000:1.0:1788875090.767306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063424 00000100:00100000:1.0:1788875090.767308:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063424 00000100:00100000:1.0:1788875090.767320:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788875090.767326:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767362:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241063296:12345-0@lo:400:kworker.0 Request processed in 36us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875090.767369:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788875090.767380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788875090.767386:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241063552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767412:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241063552:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875090.767416:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788875090.767425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788875090.767431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241063424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767454:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241063424:12345-0@lo:400:kworker.0 Request processed in 23us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875090.767459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788875090.767485:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788875090.767504:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241063552:0@lo:400:kworker.0 00000100:00080000:1.0:1788875090.767521:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788875090.767525:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875090.767541:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241063296:0@lo:400:kworker.0 00000100:00100000:1.0:1788875091.279210:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241063808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875091.279301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875091.279560:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063808 00000100:00100000:0.0:1788875091.279576:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063808 00000100:00100000:0.0:1788875091.279635:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788875091.279645:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241063808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875091.279697:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875091.279755:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241063808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875091.279762:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788875091.279968:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58ea00 x1875771241063808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875091.279987:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241063808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875091.726158:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875092.749942:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875093.775043:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875094.801150:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875095.374170:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875095.374197:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241063936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875095.374293:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875095.374461:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241063936 00000100:00100000:0.0:1788875095.374470:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241063936 00000100:00100000:0.0:1788875095.374525:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788875095.374537:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241063936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875095.374571:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875095.374620:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241063936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875095.374627:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788875095.374665:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788875095.374671:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a35973100, transno 4294967300 00000100:00100000:0.0:1788875095.374688:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241063936:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788875095.375197:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788875095.822074:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875095.838527:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875095.838581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875095.838628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875095.838906:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960576 00000100:00100000:1.0:1788875095.838918:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960576 00000100:00100000:3.0:1788875095.838944:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960704 00000100:00100000:3.0:1788875095.838949:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960704 00000100:00100000:3.0:1788875095.838988:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:1.0:1788875095.838988:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:3.0:1788875095.838998:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217960704:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875095.838998:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217960576:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875095.839075:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217960576:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 78us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875095.839083:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:0.0:1788875095.839141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960448 00000100:00100000:0.0:1788875095.839147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960448 00000100:00100000:0.0:1788875095.839180:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 280 00000100:00100000:0.0:1788875095.839187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217960448:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:1.0:1788875095.839235:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788875095.839240:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875095.839379:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217960704:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 382us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875095.839386:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:2.0:1788875095.846623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875095.846839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960832 00000100:00100000:3.0:1788875095.846850:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960832 00000100:00100000:3.0:1788875095.846937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:3.0:1788875095.846948:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217960832:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875095.847020:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217960832:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 75us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875095.847037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00080000:2.0:1788875095.847245:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875095.849161:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217960448:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 9960us (10566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875095.849175:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 280 00000100:00100000:1.0:1788875095.886566:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875095.886594:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241064064:0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.886621:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241064192:0@lo:400:kworker.0 00000100:00100000:0.0:1788875095.886690:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241064576:0@lo:400:kworker.0 00000100:00100000:3.0:1788875095.886716:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241064320:0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.891653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875095.891799:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064192 00000100:00100000:2.0:1788875095.891809:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064192 00000100:00100000:2.0:1788875095.891874:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788875095.891884:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.891950:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241064192:12345-0@lo:400:kworker.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875095.891957:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788875095.892003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241064192:0@lo:400:kworker.0 00000100:00100000:1.0:1788875095.900482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875095.900593:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241064448:0@lo:400:kworker.0 00000100:00100000:1.0:1788875095.900663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875095.900707:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064448 00000100:00100000:1.0:1788875095.900714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064448 00000100:00100000:1.0:1788875095.900764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788875095.900791:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875095.900930:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241064448:12345-0@lo:400:kworker.0 Request processed in 158us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875095.900937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1788875095.901671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875095.901723:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241064448:0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.901933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064064 00000100:00100000:2.0:1788875095.901941:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064064 00000100:00100000:2.0:1788875095.901991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788875095.902000:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241064064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.902068:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241064064:12345-0@lo:400:kworker.0 Request processed in 70us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875095.902075:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788875095.902241:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241064064:0@lo:400:kworker.0 00000100:00100000:0.0:1788875095.903462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875095.903617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875095.903742:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064320 00000100:00100000:0.0:1788875095.903749:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064320 00000100:00100000:0.0:1788875095.903866:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788875095.903875:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875095.903929:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875771241064320:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875095.903936:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788875095.903979:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875095.904007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875771241064320:0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.904175:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064576 00000100:00100000:2.0:1788875095.904179:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064576 00000100:00080000:3.0:1788875095.904217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875095.904223:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788875095.904231:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241064576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875095.904279:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241064576:12345-0@lo:400:kworker.0 Request processed in 50us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875095.904286:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788875095.905120:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3cd95f80 x1875771241064576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875095.905133:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241064576:0@lo:400:kworker.0 00000100:00100000:2.0:1788875096.403196:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241064704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875096.403317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875096.403494:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064704 00000100:00100000:0.0:1788875096.403505:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064704 00000100:00100000:0.0:1788875096.403572:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788875096.403584:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241064704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875096.403635:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875096.403701:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241064704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875096.403708:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788875096.403971:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58f480 x1875771241064704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875096.403996:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241064704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788875096.846839:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875097.873819:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788875097.998696:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788875098.894104:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875099.918287:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875100.494424:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cda4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241064832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875100.494526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875100.494695:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064832 00000100:00100000:1.0:1788875100.494707:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064832 00000100:00100000:1.0:1788875100.494832:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788875100.494846:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241064832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875100.494891:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788875100.494931:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875100.494998:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241064832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875100.495006:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788875100.495147:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cda4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241064832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788875100.943379:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875100.959962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875100.960012:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875100.960278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961088 00000100:00100000:1.0:1788875100.960292:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961088 00000100:00100000:1.0:1788875100.960402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:1.0:1788875100.960417:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217961088:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875100.960723:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217961088:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 309us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875100.960732:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:0.0:1788875100.960842:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217960960 00000100:00100000:0.0:1788875100.960848:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217960960 00000100:00100000:0.0:1788875100.960890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 282 00000100:00100000:0.0:1788875100.960898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217960960:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875100.960928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217960960:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875100.960946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 282 00000100:00080000:3.0:1788875100.961114:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875100.979482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875100.979856:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875100.981223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961344 00000100:00100000:2.0:1788875100.981240:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961344 00000100:00100000:2.0:1788875100.981362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1788875100.981377:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217961344:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875100.981588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217961344:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 214us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875100.981596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00080000:1.0:1788875100.982031:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875100.986682:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961216 00000100:00100000:3.0:1788875100.986703:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961216 00000100:00100000:3.0:1788875100.987493:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875100.987508:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2346:x1875771217961216:12345-192.168.202.7@tcp:9:kworker.0 00000020:00000080:3.0:1788875100.987548:0:6901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d823c9 00000100:00080000:3.0:1788875100.987560:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5a06244000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788875100.987628:0:6901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788875100.990541:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875100.990875:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+2:2346:x1875771217961216:12345-192.168.202.7@tcp:9:kworker.0 Request processed in 3362us (11398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875100.990891:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00080000:1.0:1788875101.001798:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875101.006163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788875101.006250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.006265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875101.006409:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241065088:0@lo:400:kworker.0 00000100:00100000:1.0:1788875101.006470:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241064960:0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.006578:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065344 00000100:00100000:2.0:1788875101.006588:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065344 00000100:00100000:2.0:1788875101.006679:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788875101.006689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875101.006694:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241065344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.006815:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241065344:12345-0@lo:400:kworker.0 Request processed in 83us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875101.006841:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788875101.006860:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065216 00000100:00100000:2.0:1788875101.006863:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065216 00000100:00100000:2.0:1788875101.006891:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788875101.006897:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241065216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.006929:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241065216:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875101.006935:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788875101.006952:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875101.006989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.007452:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241065216:0@lo:400:kworker.0 00000100:00100000:0.0:1788875101.008561:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875101.010024:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065088 00000100:00100000:3.0:1788875101.010041:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065088 00000100:00100000:3.0:1788875101.010104:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788875101.010127:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875101.010232:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241065088:12345-0@lo:400:kworker.0 Request processed in 108us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875101.010251:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788875101.010477:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241065088:0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.017802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875101.017896:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788875101.017965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875101.018061:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065472 00000100:00100000:3.0:1788875101.018076:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065472 00000100:00100000:1.0:1788875101.018172:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241064960 00000100:00100000:1.0:1788875101.018182:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241064960 00000100:00100000:3.0:1788875101.018184:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788875101.018200:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875101.018242:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788875101.018254:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241064960:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788875101.018470:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788875101.018522:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3cd94e00 x1875771241065472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875101.018537:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241065472:0@lo:400:kworker.0 00000100:00100000:3.0:1788875101.018956:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241065472:12345-0@lo:400:kworker.0 Request processed in 761us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875101.018965:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788875101.031907:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241064960:12345-0@lo:400:kworker.0 Request processed in 13640us (14128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875101.031929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788875101.031984:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241064960:0@lo:400:kworker.0 00000100:00100000:1.0:1788875101.519269:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241065600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875101.519378:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875101.519574:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065600 00000100:00100000:3.0:1788875101.519586:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065600 00000100:00100000:3.0:1788875101.519655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788875101.519667:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241065600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875101.519718:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875101.520076:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241065600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 409us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875101.520085:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788875101.524983:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58ea00 x1875771241065600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875101.525027:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241065600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875101.966070:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875102.990124:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875104.014285:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875105.038218:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875105.615446:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241065728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875105.615507:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875105.615567:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065728 00000100:00100000:2.0:1788875105.615575:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065728 00000100:00100000:2.0:1788875105.615628:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788875105.615648:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241065728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875105.615682:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875105.615719:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241065728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875105.615724:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788875105.615741:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875105.615802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241065728:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788875105.718752:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:1.0:1788875105.718796:0:6720:0:(genops.c:885:class_export_put()) final put ffff9e5a06242800/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:3.0:1788875105.727380:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06242800/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-OST0000 00000020:00000080:3.0:1788875105.727481:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a06244000 for lustre-OST0000 00010000:00010000:0.0:1788875106.062024:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875106.079220:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875106.079334:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875106.079391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875106.080811:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961728 00000100:00100000:0.0:1788875106.080826:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961728 00000100:00100000:0.0:1788875106.080892:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961600 00000100:00100000:0.0:1788875106.080896:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961600 00000100:00100000:0.0:1788875106.080931:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:0.0:1788875106.080940:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217961728:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875106.081018:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217961728:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 80us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.081026:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:0.0:1788875106.081054:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:0.0:1788875106.081062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217961600:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875106.081088:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217961600:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.081094:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00080000:0.0:1788875106.081133:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875106.082540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961472 00000100:00100000:2.0:1788875106.082550:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961472 00000100:00100000:2.0:1788875106.082705:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 284 00000100:00100000:2.0:1788875106.082715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217961472:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875106.082799:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217961472:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 85us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875106.082807:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 284 00000100:00100000:0.0:1788875106.132735:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241066112:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.132846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875106.132907:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788875106.132913:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241065984:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.132947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875106.132978:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066112 00000100:00100000:0.0:1788875106.132986:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066112 00000100:00100000:0.0:1788875106.133032:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065984 00000100:00100000:0.0:1788875106.133036:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065984 00000100:00100000:0.0:1788875106.133070:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788875106.133080:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241066112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133128:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241066112:12345-0@lo:400:kworker.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.133135:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788875106.133152:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788875106.133158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241065984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241065984:12345-0@lo:400:kworker.0 Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.133191:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788875106.133214:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875106.133243:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241065984:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241066112:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133291:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241066240:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875106.133341:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788875106.133347:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241065856:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875106.133396:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241066368:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875106.133467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241065856 00000100:00100000:0.0:1788875106.133472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241065856 00000100:00100000:0.0:1788875106.133496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788875106.133502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241065856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241065856:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.133543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788875106.133569:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066240 00000100:00100000:0.0:1788875106.133572:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066240 00000100:00100000:0.0:1788875106.133598:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788875106.133603:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241066240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133631:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241066240:12345-0@lo:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875106.133637:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788875106.133650:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875106.133669:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241065856:0@lo:400:kworker.0 00000100:00100000:0.0:1788875106.133679:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241066240:0@lo:400:kworker.0 00000100:00100000:3.0:1788875106.136183:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066368 00000100:00100000:3.0:1788875106.136199:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066368 00000100:00100000:3.0:1788875106.136268:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788875106.136277:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241066368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875106.136360:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241066368:12345-0@lo:400:kworker.0 Request processed in 84us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875106.136367:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788875106.136439:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3c58ed80 x1875771241066368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875106.136464:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241066368:0@lo:400:kworker.0 00000100:00080000:0.0:1788875106.138601:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875106.639042:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875106.639067:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cda4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241066496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875106.639140:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875106.639670:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066496 00000100:00100000:2.0:1788875106.639679:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066496 00000100:00100000:2.0:1788875106.639739:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788875106.639748:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241066496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875106.639815:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875106.639871:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241066496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875106.639878:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788875106.639999:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3cda4e00 x1875771241066496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875106.640018:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cda4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241066496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875107.086022:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788875107.214657:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788875108.109948:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875109.139073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788875109.424384:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:45:08 (1788875108) 00010000:00010000:0.0:1788875110.157977:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875110.736225:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241066624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875110.736298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875110.736559:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066624 00000100:00100000:3.0:1788875110.736570:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066624 00000100:00100000:3.0:1788875110.736707:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788875110.736730:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241066624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875110.736763:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875110.736838:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241066624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875110.736845:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788875110.736899:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875110.736936:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241066624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875110.958076:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875110.958183:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961856 00000100:00100000:0.0:1788875110.958193:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961856 00000100:00100000:0.0:1788875110.958292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1788875110.958304:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:10237:x1875771217961856:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875110.958324:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875110.958348:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d82494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b36 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958495:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958511:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875110.958562:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875110.958566:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875110.958603:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958627:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d82494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b36 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958649:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b36 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875110.958657:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875110.958659:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875110.958663:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a00030800, rc 0) 00000100:00080000:2.0:1788875110.958809:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875110.958988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:10237:x1875771217961856:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 686us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875110.959003:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:1.0:1788875110.987452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875110.987598:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217961984 00000100:00100000:0.0:1788875110.987616:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217961984 00000100:00100000:0.0:1788875110.987703:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1788875110.987724:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:10238:x1875771217961984:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875110.987746:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875110.987768:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b3d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988125:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988151:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988170:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988198:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988207:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988214:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988694:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988722:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988731:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875110.988812:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788875110.988817:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875110.988847:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988861:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988868:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988876:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988883:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875110.988888:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988897:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988911:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:1.0:1788875110.988914:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875110.988920:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988939:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d824a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988956:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988962:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988968:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988974:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875110.988977:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988984:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.988992:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e5a10bf8300) 00010000:00010000:1.0:1788875110.988994:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875110.988997:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.989003:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d824b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.989044:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b3d expref: 8 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.989065:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b3d expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875110.989079:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a10bf8f00) 00010000:00010000:1.0:1788875110.989082:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875110.989084:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26200, rc 0) 00000100:00100000:1.0:1788875110.989189:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:10238:x1875771217961984:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1475us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875110.989200:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:3.0:1788875110.992157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875110.994018:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217962240 00000100:00100000:2.0:1788875110.994034:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217962240 00000100:00100000:2.0:1788875110.994135:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:2.0:1788875110.994146:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:10238:x1875771217962240:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875110.994169:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875110.994193:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b44 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994271:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994286:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994298:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994313:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994320:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994326:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994746:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18c00/0x60858e6020d824d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994758:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18c00/0x60858e6020d824d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.994767:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18c00/0x60858e6020d824d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875110.994864:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788875110.995052:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995060:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995066:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995071:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875110.995076:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995084:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995096:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a10bf8f00) 00010000:00010000:2.0:1788875110.995099:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875110.995105:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995111:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995125:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995130:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995145:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995150:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875110.995153:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995158:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995165:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e5a045bab00) 00010000:00010000:2.0:1788875110.995167:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875110.995169:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995174:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995642:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b44 expref: 10 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995660:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18c00/0x60858e6020d824d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b44 expref: 9 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875110.995668:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:2.0:1788875110.995670:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875110.995672:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18c00, rc 0) 00000100:00100000:2.0:1788875110.995760:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10238:x1875771217962240:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1615us (3618us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788875110.995802:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:0.0:1788875111.003183:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875111.003308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217962368 00000100:00100000:1.0:1788875111.003318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217962368 00000100:00100000:1.0:1788875111.003377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:1.0:1788875111.003387:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10238:x1875771217962368:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788875111.003499:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10238:x1875771217962368:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875111.003506:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00010000:00010000:0.0:1788875111.187811:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875111.201276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875111.201332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875111.201491:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217962624 00000100:00100000:2.0:1788875111.201515:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217962624 00000100:00100000:2.0:1788875111.201607:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:2.0:1788875111.201627:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217962624:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875111.201737:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2348:x1875771217962624:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875111.201747:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00080000:0.0:1788875111.201874:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875111.205331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217962496 00000100:00100000:3.0:1788875111.205353:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217962496 00000100:00100000:2.0:1788875111.206876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 286 00000100:00100000:2.0:1788875111.206896:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217962496:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875111.206984:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771217962496:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 97us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875111.206992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 286 00000100:00100000:1.0:1788875111.249958:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241066880:0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.250048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875111.250133:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241067392:0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.250169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875111.251378:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788875111.251394:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.251459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875111.251514:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241067264:0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.251545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875111.251603:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241067392 00000100:00100000:1.0:1788875111.251612:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241067392 00000100:00100000:3.0:1788875111.251631:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066880 00000100:00100000:3.0:1788875111.251646:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066880 00000100:00100000:1.0:1788875111.251692:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788875111.251702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241067264 00000100:00100000:1.0:1788875111.251720:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241067392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875111.251723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241067264 00000100:00100000:3.0:1788875111.251768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788875111.251815:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241066880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.251827:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241067392:12345-0@lo:400:kworker.0 Request processed in 117us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875111.251903:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241066880:12345-0@lo:400:kworker.0 Request processed in 92us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875111.251912:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788875111.251933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788875111.251939:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241067264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875111.251967:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241067264:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875111.251981:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788875111.252540:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241067008:0@lo:400:kworker.0 00000100:00100000:2.0:1788875111.252603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875111.252646:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875111.252655:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241067136:0@lo:400:kworker.0 00000100:00100000:2.0:1788875111.252685:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875111.252733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241067008 00000100:00100000:2.0:1788875111.252740:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241067008 00000100:00100000:2.0:1788875111.252797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788875111.252806:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241067008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875111.252848:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241067008:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875111.252867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788875111.252918:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241067008:0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.252991:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788875111.253029:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241067136 00000100:00100000:1.0:1788875111.253037:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241067136 00000100:00100000:1.0:1788875111.253137:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788875111.253146:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875111.253231:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241067136:12345-0@lo:400:kworker.0 Request processed in 87us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875111.253232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241066752 00000100:00100000:0.0:1788875111.253242:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241066752 00000100:00100000:1.0:1788875111.253245:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788875111.253293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788875111.253302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241066752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875111.253347:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241066752:12345-0@lo:400:kworker.0 Request processed in 47us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875111.253354:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1788875111.253389:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788875111.253395:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875111.260313:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241067136:0@lo:400:kworker.0 00000100:00100000:0.0:1788875111.264296:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241066752:0@lo:400:kworker.0 00000100:00100000:0.0:1788875111.264329:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241067264:0@lo:400:kworker.0 00000100:00100000:0.0:1788875111.264345:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241066880:0@lo:400:kworker.0 00010000:00080000:0.0:1788875111.264387:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d3d8700 x1875771241067392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788875127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875111.264400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241067392:0@lo:400:kworker.0 00000040:00080000:1.0:1788875111.315344:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788875111.765260:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788875111.765287:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241067520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875111.765363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875111.765640:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241067520 00000100:00100000:1.0:1788875111.765648:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241067520 00000100:00100000:1.0:1788875111.765701:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788875111.765720:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241067520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875111.765755:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875111.765827:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241067520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875111.765835:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788875111.765873:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3d035500 x1875771241067520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875111.765891:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241067520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788875112.209580:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875113.233095:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875113.421210:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.421301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217962752 00000100:00100000:2.0:1788875113.421311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217962752 00000100:00100000:2.0:1788875113.421394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1788875113.421405:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10280:x1875771217962752:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875113.421429:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875113.421453:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b4b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421536:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421554:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421566:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421593:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421601:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421608:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421880:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421888:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421895:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421900:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875113.421905:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421913:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421926:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:2.0:1788875113.421929:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875113.421933:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421939:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d824e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421951:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421957:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421962:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421974:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875113.421977:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421984:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.421992:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e5a045ba300) 00010000:00010000:2.0:1788875113.421994:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875113.421997:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.422003:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d824ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.422036:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b4b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.422045:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:2.0:1788875113.422047:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875113.422051:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d824e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b4b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.422061:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:2.0:1788875113.422132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10280:x1875771217962752:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 730us (933us total) trans 0 rc 301/301 00000100:00100000:2.0:1788875113.422140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00080000:1.0:1788875113.422396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875113.461739:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.468415:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963008 00000100:00100000:0.0:1788875113.468431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963008 00000100:00100000:0.0:1788875113.469488:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1788875113.469503:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10280:x1875771217963008:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:0.0:1788875113.469566:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875113.469610:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d8249b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b36 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875113.469645:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875113.469911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469936:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469948:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469967:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.469975:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875113.474911:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788875113.474933:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.474944:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.474952:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.474958:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875113.474962:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.474970:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.474987:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875113.474990:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875113.474994:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.475001:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d824f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875113.475033:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb7c3f6e reply state 00000000b10795fc transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875113.475043:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875113.475167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:10280:x1875771217963008:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 5664us (13433us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788875113.475177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00010000:00010000:1.0:1788875113.481452:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481481:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481490:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481497:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875113.481502:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481510:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481528:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e5a0bc0dc00) 00010000:00010000:1.0:1788875113.481531:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875113.481536:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875113.481542:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d824fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875113.591618:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875113.591754:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963136 00000100:00100000:3.0:1788875113.591765:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963136 00000100:00100000:3.0:1788875113.591856:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:3.0:1788875113.591868:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:10288:x1875771217963136:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:3.0:1788875113.591894:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875113.591920:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b52 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.591987:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.592002:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.592014:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875113.592050:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788875113.592054:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875113.592090:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.592115:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b52 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.592133:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b52 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.592161:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875113.592165:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875113.592169:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15c00, rc 0) 00000100:00100000:3.0:1788875113.592237:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:10288:x1875771217963136:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 371us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875113.592256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:1.0:1788875113.674673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875113.674842:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963264 00000100:00100000:3.0:1788875113.674854:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963264 00000100:00100000:3.0:1788875113.674926:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:3.0:1788875113.674940:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:10294:x1875771217963264:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875113.674965:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875113.674989:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b59 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675073:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675092:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675106:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675123:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675131:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675159:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675296:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675305:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675312:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875113.675342:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788875113.675346:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875113.675384:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675398:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675405:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675412:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675419:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875113.675423:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675431:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675452:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875113.675455:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875113.675460:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675467:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675483:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675489:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675495:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675500:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875113.675503:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675509:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675517:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e5a10903800) 00010000:00010000:3.0:1788875113.675519:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875113.675522:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675528:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675573:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b59 expref: 12 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675587:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b59 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.675595:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875113.675597:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788875113.675600:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14000, rc 0) 00000100:00100000:3.0:1788875113.675684:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:10294:x1875771217963264:12345-192.168.202.7@tcp:101:bash.0 Request processed in 747us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875113.675702:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:1.0:1788875113.688034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.690161:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963520 00000100:00100000:0.0:1788875113.690176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963520 00000100:00100000:0.0:1788875113.690299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1788875113.690310:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:10294:x1875771217963520:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875113.690330:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875113.690351:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d8252e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690494:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690510:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690522:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690588:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690597:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.690618:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788875113.691207:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788875113.691392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691403:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691412:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691446:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691453:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691460:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691466:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875113.691471:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691479:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875113.691494:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875113.691507:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691514:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030800/0x60858e6020d82535 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875113.691530:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000975dd26a reply state 00000000c6fe7b6b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875113.691538:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788875113.691571:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030400/0x60858e6020d8252e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691585:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.691593:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875113.691595:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875113.691597:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1000, rc 0) 00000100:00100000:0.0:1788875113.691696:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10294:x1875771217963520:12345-192.168.202.7@tcp:101:bash.0 Request processed in 1377us (3666us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788875113.691704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:1.0:1788875113.697499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:0.0:1788875113.697570:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697584:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697593:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697617:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00030200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875113.697623:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697631:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697649:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875113.697652:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875113.697656:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.697663:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a00030200/0x60858e6020d8253c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875113.697751:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963648 00000100:00100000:2.0:1788875113.697766:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963648 00000100:00100000:2.0:1788875113.697832:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:2.0:1788875113.697840:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875771217963648:12345-192.168.202.7@tcp:8:bash.0 00010000:00080000:2.0:1788875113.697871:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:2.0:1788875113.697899:0:6697:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d82551 00002000:00100000:2.0:1788875113.697910:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd989c2b-3da6-48fe-ae0a-99ed44fd91eb/ffff9e5a044ae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788875113.697934:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788875113.698169:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788875113.698198:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e5a044af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875113.698264:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217963648:12345-192.168.202.7@tcp:8:bash.0 Request processed in 422us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875113.698272:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1788875113.701496:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.701571:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963776 00000100:00100000:0.0:1788875113.701581:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963776 00000100:00100000:0.0:1788875113.701655:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:0.0:1788875113.701665:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:0:x1875771217963776:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875113.701681:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875113.701715:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b67 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875113.701743:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875113.701763:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788875113.701768:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875113.701814:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.701856:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.701871:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1800, rc 0) 00000100:00100000:0.0:1788875113.701928:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:0:x1875771217963776:12345-192.168.202.7@tcp:101:bash.0 Request processed in 265us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875113.701935:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00080000:1.0:1788875113.702102:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875113.709643:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.709760:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217963904 00000100:00100000:2.0:1788875113.709855:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217963904 00000100:00100000:2.0:1788875113.709917:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1788875113.709927:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:10294:x1875771217963904:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1788875113.709945:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875113.709968:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b6e expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.710000:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.710009:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875113.710013:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875113.710020:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.710178:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.710195:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875113.710209:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241067648:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875113.710360:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875113.722879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875113.723033:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241067648:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875113.723069:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875113.723090:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:3.0:1788875113.723157:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:10294:x1875771217963904:12345-192.168.202.7@tcp:101:bash.0 Request processed in 13231us (13525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875113.723166:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:0.0:1788875113.723360:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217964032 00000100:00100000:0.0:1788875113.723368:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217964032 00010000:00010000:0.0:1788875113.723400:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875113.723434:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:0.0:1788875113.723441:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217964032:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875113.723455:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875113.723484:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.723496:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.723517:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d82558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b67 expref: 8 pid: 6696 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.723546:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875113.723550:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875113.723571:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.723582:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.723618:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875113.723631:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875771241067776:192.168.202.7@tcp:105: 00000100:00100000:0.0:1788875113.723728:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bce56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875113.732488:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875771241067776:192.168.202.7@tcp:105: 00010000:00010000:0.0:1788875113.732521:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875113.732641:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217964032:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 9198us (9771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875113.732652:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1788875113.734276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.734336:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217964288 00000100:00100000:2.0:1788875113.734345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217964288 00000100:00100000:2.0:1788875113.734474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1788875113.734484:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10294:x1875771217964288:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:2.0:1788875113.735337:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10294:x1875771217964288:12345-192.168.202.7@tcp:35:bash.0 Request processed in 851us (1064us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788875113.735465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875113.840111:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.840245:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217964544 00000100:00100000:2.0:1788875113.840256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217964544 00000100:00100000:2.0:1788875113.840328:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:2.0:1788875113.840339:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10304:x1875771217964544:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875113.840364:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875113.840387:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b75 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875113.840489:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788875113.840622:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82566 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b75 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.840636:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:2.0:1788875113.840639:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875113.840645:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b75 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.840658:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875113.840752:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10304:x1875771217964544:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 414us (649us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788875113.840759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:1.0:1788875113.844279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.844534:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217964800 00000100:00100000:2.0:1788875113.844545:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217964800 00000100:00100000:2.0:1788875113.844618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1788875113.844630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10304:x1875771217964800:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875113.844997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10304:x1875771217964800:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 368us (726us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788875113.845006:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:3.0:1788875113.940485:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.940569:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217964928 00000100:00100000:2.0:1788875113.940581:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217964928 00000100:00100000:2.0:1788875113.940732:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1788875113.940743:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10310:x1875771217964928:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875113.940796:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875113.940850:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b7c expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.940923:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.940936:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.940948:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875113.940981:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788875113.940984:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875113.941002:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.941026:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b7c expref: 18 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.941044:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b7c expref: 17 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.941053:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875113.941056:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875113.941060:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:2.0:1788875113.941124:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10310:x1875771217964928:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 384us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875113.941132:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:1.0:1788875113.946810:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.946900:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965184 00000100:00100000:0.0:1788875113.946911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965184 00000100:00100000:0.0:1788875113.946976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:0.0:1788875113.946987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10310:x1875771217965184:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875113.947008:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875113.947028:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82582 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b83 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.947139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.947153:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.947164:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875113.947175:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788875113.947326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82582 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b83 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.947346:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b83 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.947354:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875113.947356:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875113.947360:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0800, rc 0) 00000100:00100000:0.0:1788875113.947439:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10310:x1875771217965184:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 454us (674us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788875113.947446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:1.0:1788875113.953632:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.953806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965440 00000100:00100000:2.0:1788875113.953828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965440 00000100:00100000:2.0:1788875113.953888:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:2.0:1788875113.953898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10310:x1875771217965440:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875113.953923:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875113.953944:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b8a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.954041:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.954058:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.954071:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875113.954083:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788875113.954208:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b8a expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.954227:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b8a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.954236:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:2.0:1788875113.954239:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788875113.954243:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:2.0:1788875113.954308:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10310:x1875771217965440:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 410us (685us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788875113.954315:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1788875113.962532:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.962695:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965568 00000100:00100000:0.0:1788875113.962706:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965568 00000100:00100000:0.0:1788875113.962794:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1788875113.962804:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:2347:x1875771217965568:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875113.962819:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875113.962853:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b83 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.962872:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875113.962877:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875113.962922:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:2347:x1875771217965568:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 121us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875113.962929:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:3.0:1788875113.967850:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875113.968007:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965696 00000100:00100000:0.0:1788875113.968017:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965696 00000100:00100000:0.0:1788875113.968075:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:0.0:1788875113.968084:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217965696:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:0.0:1788875113.968130:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.968155:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.968165:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875113.968169:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788875113.968174:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.968212:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875113.968226:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875113.968256:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875771241067904:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875113.968339:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bce56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875113.973752:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875113.973892:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965824 00000100:00100000:2.0:1788875113.973901:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965824 00002000:00100000:2.0:1788875113.973947:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e5a3d3daa00 x1875771217965824/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:19/0 lens 504/0 e 0 to 0 dl 1788875124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875113.973959:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d3daa00 with x1875771217965824 ext(0->12) 00010000:00010000:2.0:1788875113.973968:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 8 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875113.973984:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 8 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875113.973992:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d3daa00 00000100:00100000:2.0:1788875113.974022:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1788875113.974031:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771217965824:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:0.0:1788875113.974763:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875771241067904:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875113.974813:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788875114.003859:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000001:00080000:1.0:1788875114.036901:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788875114.037016:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217965824:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 62979us (63267us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788875114.037032:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00002000:00100000:1.0:1788875114.037045:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e5a3d3daa00 x1875771217965824/t4294967299(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:19/0 lens 504/448 e 0 to 0 dl 1788875124 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788875114.037054:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d3daa00 with x1875771217965824 ext(0->12) 00010000:00010000:1.0:1788875114.037065:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.037082:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788875114.037090:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d3daa00 00000100:00100000:1.0:1788875114.045848:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.045945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217965952 00000100:00100000:2.0:1788875114.045955:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217965952 00010000:00010000:2.0:1788875114.045992:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.046024:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1788875114.046033:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771217965952:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875114.046047:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788875114.046065:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788875114.046068:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788875114 00002000:00010000:2.0:1788875114.046070:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788875114 00002000:00010000:2.0:1788875114.046073:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788875114 00002000:00010000:2.0:1788875114.046099:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788875114.046105:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.046119:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.046142:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d8255f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b6e expref: 7 pid: 6697 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.046157:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875114.046162:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875114.046167:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.046175:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.046211:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875114.046266:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217965952:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 233us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875114.046274:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00010000:00010000:3.0:1788875114.048515:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048533:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048569:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048577:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048585:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048593:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875114.048597:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048606:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048629:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.048637:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50e0321/0x60858e6020d825ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875114.048762:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217965696:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 80674us (80917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875114.048804:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:1.0:1788875114.053314:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875114.053486:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217966208 00000100:00100000:3.0:1788875114.053495:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217966208 00000100:00100000:3.0:1788875114.053550:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:3.0:1788875114.053560:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:10310:x1875771217966208:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:3.0:1788875114.053623:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b8a expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875114.053950:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788875114.054009:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788875114.055892:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788875114.055982:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.056002:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.056010:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.056052:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.056068:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 24 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875114.056097:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875771241068032:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875114.056261:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788875114.060121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.060199:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217966336 00000100:00100000:0.0:1788875114.060207:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217966336 00010000:00010000:0.0:1788875114.060247:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 25 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875114.060287:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1788875114.060297:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:2347:x1875771217966336:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875114.060313:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875114.060319:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 25 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.060333:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 25 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.060356:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875114.060361:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.060398:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.060405:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.060422:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875114.060489:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:2347:x1875771217966336:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 193us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875114.060495:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00010000:00010000:3.0:1788875114.063020:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b60 expref: 24 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875114.063046:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875771241068032:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875114.063075:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.063174:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.063182:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875114.063301:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788875114.063642:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788875114.064044:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241068160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788875114.064120:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875114.064156:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875114.064297:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241068160 00000100:00100000:2.0:1788875114.064304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241068160 00000100:00100000:2.0:1788875114.064378:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788875114.064387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875771241068160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788875114.064469:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875771241068160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875114.064585:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241068160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788875114.065261:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788875114.065331:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241068288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788875114.065372:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875114.065393:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788875114.065424:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788875114.065434:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788875114.065984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241068288 00000100:00100000:3.0:1788875114.065991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241068288 00000100:00100000:3.0:1788875114.066094:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875114.066104:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5845:x1875771241068288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788875114.066324:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5845:x1875771241068288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (952us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788875114.066332:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875114.066370:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241068288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788875114.066420:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788875114.066456:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066466:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066487:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066493:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.066498:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066506:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066521:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:3.0:1788875114.066524:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788875114.066528:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.066545:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875114.066717:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788875114.066942:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788875114.066954:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328932181350ns, next at 329932178693ns, rc = 0 00000001:00080000:3.0:1788875114.066961:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788875114.066990:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:3.0:1788875114.066993:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788875114.067000:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8259e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b8a expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875114.067112:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:10310:x1875771217966208:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 13553us (13807us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788875114.067119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000020:00080000:3.0:1788875114.067122:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788875114.067654:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788875114.067888:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875114.070860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875114.070950:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217966464 00000100:00100000:3.0:1788875114.070961:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217966464 00000100:00100000:3.0:1788875114.071049:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1788875114.071059:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:10310:x1875771217966464:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875114.071082:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875114.071107:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d825ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b91 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.071167:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d825ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b91 expref: 28 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.071203:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d825ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b91 expref: 28 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.071223:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875114.071226:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875114.071229:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:3.0:1788875114.071293:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:10310:x1875771217966464:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 235us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875114.071300:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1788875114.075123:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.075208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217966720 00000100:00100000:2.0:1788875114.075217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217966720 00000100:00100000:2.0:1788875114.075267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1788875114.075276:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:10310:x1875771217966720:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875114.075514:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10310:x1875771217966720:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 239us (400us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788875114.075522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1788875114.173907:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.174013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217966976 00000100:00100000:0.0:1788875114.174024:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217966976 00000100:00100000:0.0:1788875114.174087:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1788875114.174098:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10320:x1875771217966976:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875114.174120:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875114.174141:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d825c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875114.174228:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788875114.174346:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d825c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b98 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.174362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:0.0:1788875114.174376:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875114.174381:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d825c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b98 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.174416:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:0.0:1788875114.174484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10320:x1875771217966976:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 388us (588us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788875114.174491:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:1.0:1788875114.178811:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875114.178990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217967104 00000100:00100000:3.0:1788875114.179001:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217967104 00000100:00100000:3.0:1788875114.179067:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:3.0:1788875114.179078:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10320:x1875771217967104:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:3.0:1788875114.179156:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179173:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179186:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179202:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179209:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179232:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179313:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179322:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179329:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875114.179381:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179393:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179400:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179407:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179412:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.179417:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179425:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875114.179444:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.179449:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179468:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179484:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179490:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179494:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.179497:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179503:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10903100) 00010000:00010000:3.0:1788875114.179512:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.179514:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179519:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179535:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179545:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179550:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179554:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.179557:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179562:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179568:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875114.179570:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.179572:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.179577:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875114.179741:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10320:x1875771217967104:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 664us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875114.179748:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:1.0:1788875114.186446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.186587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217967360 00000100:00100000:2.0:1788875114.186597:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217967360 00000100:00100000:2.0:1788875114.186652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875114.186673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10320:x1875771217967360:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875114.186959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:10320:x1875771217967360:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 288us (523us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788875114.186967:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:1.0:1788875114.238261:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875114.238346:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217967616 00000100:00100000:3.0:1788875114.238356:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217967616 00000100:00100000:3.0:1788875114.238426:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875114.238436:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:10323:x1875771217967616:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875114.238458:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875114.238498:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0b9f expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238567:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238582:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238593:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238608:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238615:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238621:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238750:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238758:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238765:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875114.238810:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788875114.238904:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238921:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238927:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238932:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.238936:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238942:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238954:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875114.238957:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.238961:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238967:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d825eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238980:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238985:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238990:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.238996:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.239004:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239010:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239017:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10903100) 00010000:00010000:3.0:1788875114.239020:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.239023:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239027:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d825f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239071:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d825e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 34 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239084:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 33 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.239090:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875114.239092:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875114.239095:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788875114.239147:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10323:x1875771217967616:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 712us (897us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788875114.239154:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:1.0:1788875114.247869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.247977:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217967744 00000100:00100000:2.0:1788875114.247987:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217967744 00000100:00100000:2.0:1788875114.248047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1788875114.248057:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10323:x1875771217967744:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1788875114.248122:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248138:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248164:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248190:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248196:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248203:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248209:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875114.248213:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248220:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248231:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875114.248234:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875114.248239:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.248246:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82607 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.248320:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10323:x1875771217967744:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 264us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875114.248328:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00010000:00010000:0.0:1788875114.254093:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875114.255054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.255145:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217968000 00000100:00100000:2.0:1788875114.255167:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217968000 00000100:00100000:2.0:1788875114.255225:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875114.255236:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10323:x1875771217968000:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875114.255512:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:10323:x1875771217968000:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 278us (466us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788875114.255519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1788875114.539518:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.539663:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217968256 00000100:00100000:2.0:1788875114.539674:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217968256 00000100:00100000:2.0:1788875114.539809:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:2.0:1788875114.539820:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:10354:x1875771217968256:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1788875114.539845:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875114.539865:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8260e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ba6 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.539971:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.539985:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.539996:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875114.540007:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788875114.540166:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8260e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ba6 expref: 37 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.540186:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ba6 expref: 36 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.540205:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875114.540208:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875114.540212:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875114.540314:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:10354:x1875771217968256:12345-192.168.202.7@tcp:101:cat.0 Request processed in 495us (805us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788875114.540321:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:1.0:1788875114.543718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875114.543842:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.543982:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217968384 00000100:00100000:0.0:1788875114.543994:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217968384 00000100:00100000:0.0:1788875114.544063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:0.0:1788875114.544072:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:2348:x1875771217968384:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875114.544089:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875114.544113:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ba6 expref: 36 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.544131:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:0.0:1788875114.544136:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875114.544201:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:2348:x1875771217968384:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 131us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875114.544209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1788875114.544452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217968640 00000100:00100000:2.0:1788875114.544457:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217968640 00000100:00100000:2.0:1788875114.544518:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1788875114.544526:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:10354:x1875771217968640:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:2.0:1788875114.544752:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:10354:x1875771217968640:12345-192.168.202.7@tcp:35:cat.0 Request processed in 226us (1043us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788875114.544759:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1788875114.623617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.623749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217968896 00000100:00100000:0.0:1788875114.623761:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217968896 00000100:00100000:0.0:1788875114.623853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1788875114.623862:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:10360:x1875771217968896:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:0.0:1788875114.623898:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875114.623902:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788875114.623930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8257b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b7c expref: 36 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.623962:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875114.623967:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875114.623982:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82623 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.624073:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.624098:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 36 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.624107:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.624142:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 36 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.624155:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 36 pid: 11390 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875114.624167:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241068416:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875114.624267:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876300 going to sleep for 11 seconds 00000100:00100000:1.0:1788875114.629020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.629118:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241068416:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875114.629145:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.629225:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217969024 00000100:00100000:2.0:1788875114.629231:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217969024 00010000:00010000:2.0:1788875114.629276:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 37 pid: 11390 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.629312:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1788875114.629322:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:2348:x1875771217969024:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875114.629337:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875114.629344:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 37 pid: 11390 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629386:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 37 pid: 11390 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629409:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d825f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b9f expref: 37 pid: 11390 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629423:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875114.629427:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629436:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629444:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.629469:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875114.629606:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.629620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875114.629638:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788875114.629856:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82623 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.629876:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.629883:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:0.0:1788875114.629895:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788875114.629899:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1c00, rc 0) 00000100:00100000:2.0:1788875114.630040:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:2348:x1875771217969024:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 717us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875114.630049:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:0.0:1788875114.630112:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:10360:x1875771217968896:12345-192.168.202.7@tcp:101:dd.0 Request processed in 6251us (6505us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788875114.630120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1788875114.633220:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.633390:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217969280 00000100:00100000:2.0:1788875114.633399:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217969280 00000100:00100000:2.0:1788875114.633454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1788875114.633464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:10360:x1875771217969280:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:2.0:1788875114.633999:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.634013:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.634033:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875114.634071:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788875114.634099:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e778f813 reply state 00000000a7a8d4d6 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.634105:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875114.634175:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:10360:x1875771217969280:12345-192.168.202.7@tcp:36:dd.0 Request processed in 714us (967us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788875114.634180:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000020:00080000:2.0:1788875114.634184:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788875114.636564:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636580:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636588:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636594:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875114.636599:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636606:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636624:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:1.0:1788875114.636628:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875114.636632:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875114.636639:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875114.928145:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875114.928215:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217969408 00000100:00100000:2.0:1788875114.928224:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217969408 00000100:00100000:2.0:1788875114.928350:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875114.928361:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:10374:x1875771217969408:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:2.0:1788875114.928387:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875114.928409:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8263f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bb4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928475:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928490:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928500:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928536:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928546:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928552:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928639:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928650:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928690:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928725:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875114.928740:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 39 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875114.928755:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241068544:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875114.928891:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5901082900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875114.932285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.932454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217969664 00000100:00100000:0.0:1788875114.932473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217969664 00000100:00100000:0.0:1788875114.932532:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875114.932543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:5589:x1875771217969664:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788875114.932938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:5589:x1875771217969664:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 395us (661us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788875114.932946:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1788875114.933612:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241068544:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875114.933639:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875114.938552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875114.939053:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217969792 00000100:00100000:0.0:1788875114.939063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217969792 00010000:00010000:0.0:1788875114.939105:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 41 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875114.939160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:0.0:1788875114.939171:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:2347:x1875771217969792:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875114.939186:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875114.939193:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 41 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939207:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 41 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939228:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8262a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bad expref: 41 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939247:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:0.0:1788875114.939253:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939262:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939270:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875114.939299:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875114.939561:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:2347:x1875771217969792:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 391us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875114.939568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00010000:00010000:3.0:1788875114.939631:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939639:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875114.939698:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788875114.939702:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875114.939742:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939755:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939763:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939802:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939810:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939816:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.939820:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939828:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939837:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875114.939845:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.939849:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939856:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939868:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939874:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939880:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939884:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875114.939887:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939892:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939899:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045ba300) 00010000:00010000:3.0:1788875114.939901:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875114.939903:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939908:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8264d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939940:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8263f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bb4 expref: 40 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939964:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bb4 expref: 39 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875114.939971:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875114.939973:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875114.939976:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:3.0:1788875114.940001:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:10374:x1875771217969408:12345-192.168.202.7@tcp:101:stat.0 Request processed in 11643us (11865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875114.940008:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:1.0:1788875115.069590:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875115.070312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217970048 00000100:00100000:0.0:1788875115.070448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217970048 00000100:00100000:0.0:1788875115.072231:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:0.0:1788875115.072252:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:10380:x1875771217970048:12345-192.168.202.7@tcp:36:truncate.0 00010000:00010000:0.0:1788875115.072310:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875115.072349:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bb4 expref: 39 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.072370:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:0.0:1788875115.072375:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875115.072568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.072587:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.072597:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875115.072645:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788875115.072683:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002870e001 reply state 0000000093a37b33 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875115.072692:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875115.072881:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:10380:x1875771217970048:12345-192.168.202.7@tcp:36:truncate.0 Request processed in 637us (3300us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788875115.072889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000020:00080000:0.0:1788875115.072894:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788875115.074332:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074346:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074353:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074367:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875115.074372:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074380:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074394:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875115.074396:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875115.074401:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.074417:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8265b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788875115.075507:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788875115.278045:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875115.453131:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.453909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217970176 00000100:00100000:3.0:1788875115.453920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217970176 00000100:00100000:3.0:1788875115.453991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1788875115.454002:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:10394:x1875771217970176:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:3.0:1788875115.454026:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875115.454049:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bbb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454122:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454135:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454160:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454166:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454171:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454257:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454279:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454286:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875115.454321:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788875115.454325:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875115.454346:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454357:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454366:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454372:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454378:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454383:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875115.454387:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454395:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454406:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875115.454415:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875115.454420:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454427:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454442:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454447:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454453:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454457:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875115.454460:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454466:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454473:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10903100) 00010000:00010000:3.0:1788875115.454476:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875115.454479:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454484:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454517:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454543:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.454550:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875115.454552:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875115.454554:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788875115.461796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:10394:x1875771217970176:12345-192.168.202.7@tcp:101:stat.0 Request processed in 7764us (8641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875115.461813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:0.0:1788875115.626879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.628385:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217970432 00000100:00100000:3.0:1788875115.628407:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217970432 00000100:00100000:3.0:1788875115.628479:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:3.0:1788875115.628491:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:10404:x1875771217970432:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875115.628511:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875115.628530:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d8267e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bc2 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875115.628630:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788875115.628750:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d8267e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc2 expref: 43 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.628764:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875115.628767:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875115.628772:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d8267e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc2 expref: 43 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.628852:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875115.628922:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+42:10404:x1875771217970432:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 433us (2054us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788875115.628929:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1788875115.634558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875115.634819:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217970688 00000100:00100000:0.0:1788875115.634838:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217970688 00000100:00100000:0.0:1788875115.634897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1788875115.634907:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+42:10404:x1875771217970688:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1788875115.635144:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:10404:x1875771217970688:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 238us (597us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788875115.635152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1788875115.780028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.780129:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217970944 00000100:00100000:3.0:1788875115.780139:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217970944 00000100:00100000:3.0:1788875115.780195:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:3.0:1788875115.780204:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:10410:x1875771217970944:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875115.780227:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875115.780248:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d8268c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bc9 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.780359:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.780375:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.780384:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.781193:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.781209:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 44 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875115.781238:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241068672:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875115.781361:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f07f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875115.787589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875115.787740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217971072 00000100:00100000:1.0:1788875115.787750:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217971072 00000100:00100000:3.0:1788875115.787834:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241068672:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875115.787861:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.787926:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 45 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875115.787964:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:1.0:1788875115.787975:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:2347:x1875771217971072:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875115.787992:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875115.788000:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 45 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788013:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 45 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788037:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bbb expref: 45 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788053:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:1.0:1788875115.788059:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788068:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788075:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.788100:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875115.788123:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.788133:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875115.788151:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1788875115.788159:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:2347:x1875771217971072:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 185us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875115.788182:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00010000:00010000:3.0:1788875115.789405:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d8268c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 45 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.789480:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 44 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.789490:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:3.0:1788875115.789493:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875115.789496:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875115.790032:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:10410:x1875771217970944:12345-192.168.202.7@tcp:101:bash.0 Request processed in 9827us (10014us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788875115.790042:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1788875115.797257:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.797344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217971328 00000100:00100000:3.0:1788875115.797366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217971328 00000100:00100000:3.0:1788875115.797435:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:3.0:1788875115.797446:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:10410:x1875771217971328:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:3.0:1788875115.797717:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.797735:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.797748:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875115.797833:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788875115.797855:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9fb9899 reply state 0000000055b7aa60 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875115.797863:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788875115.797949:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10410:x1875771217971328:12345-192.168.202.7@tcp:36:bash.0 Request processed in 503us (702us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788875115.797956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000020:00080000:3.0:1788875115.797961:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788875115.803880:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803898:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803906:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803912:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875115.803917:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803925:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803942:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:1.0:1788875115.803945:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875115.803951:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.803958:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d826a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875115.810809:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875115.811445:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217971456 00000100:00100000:0.0:1788875115.811456:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217971456 00000100:00100000:0.0:1788875115.811521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:0.0:1788875115.811533:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:10410:x1875771217971456:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875115.811557:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875115.811587:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d826a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bd0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.811700:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.811716:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 47 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.811726:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.811759:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 47 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875115.811800:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 47 pid: 11390 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875115.811828:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241068800:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875115.811926:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:0.0:1788875115.815840:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241068800:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875115.815870:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875115.816499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875115.816709:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217971584 00000100:00100000:1.0:1788875115.816718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217971584 00010000:00010000:1.0:1788875115.816757:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 48 pid: 11390 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875115.816837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:1.0:1788875115.816860:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+48:2348:x1875771217971584:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875115.816876:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875115.816884:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 48 pid: 11390 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.816898:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 48 pid: 11390 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.816922:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82693 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bc9 expref: 48 pid: 11390 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.816941:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:1.0:1788875115.816947:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.816958:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.816966:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.817006:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875115.817066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:2348:x1875771217971584:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 206us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875115.817074:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00010000:00010000:2.0:1788875115.817434:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.817443:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875115.817486:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788875115.817490:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875115.817510:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.817539:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d826a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bd0 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.817555:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bd0 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.817625:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875115.817629:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875115.817633:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0000, rc 0) 00000100:00100000:2.0:1788875115.817683:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:10410:x1875771217971456:12345-192.168.202.7@tcp:101:bash.0 Request processed in 6152us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875115.817689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:2.0:1788875115.823215:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875115.823356:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217971840 00000100:00100000:0.0:1788875115.823366:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217971840 00000100:00100000:0.0:1788875115.823420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:0.0:1788875115.823430:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:10410:x1875771217971840:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1788875115.823683:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10410:x1875771217971840:12345-192.168.202.7@tcp:35:bash.0 Request processed in 254us (477us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788875115.823690:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1788875115.854467:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241068928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875115.854552:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875115.854877:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241068928 00000100:00100000:3.0:1788875115.854885:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241068928 00000100:00100000:3.0:1788875115.854943:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788875115.854952:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241068928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875115.854984:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875115.855028:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241068928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875115.855035:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788875115.855128:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241068928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788875115.855171:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788875115.912416:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:3.0:1788875115.912523:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788875115.912548:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a04fd8d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788875115.912553:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a028d6300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a0456fcc0 00000020:00080000:3.0:1788875115.912557:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a028d6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a1b680000 00000020:00080000:1.0:1788875115.912699:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788875115.912857:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788875115.913791:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241069056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788875115.913866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875115.913949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069056 00000100:00100000:1.0:1788875115.913956:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069056 00000100:00100000:1.0:1788875115.914004:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788875115.914012:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241069056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788875115.914037:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788875115.914068:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa0116a, atime: 0x6aa0116a, ctime: 0x6aa0116a, blocks: 0xb 00010000:00010000:1.0:1788875115.914076:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914092:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1788875115.914096:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875115.914102:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914119:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914129:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914137:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914184:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788875115.914917:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241069056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 903us (1049us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788875115.914926:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788875115.914962:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875115.914969:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914979:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875115.914983:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.914993:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.915011:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.915019:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091811f75/0x60858e6020d826b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875115.915038:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875115.915040:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875115.915042:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788875115.915076:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a3c58f100/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788875115.915082:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241069056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788875115.929105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.929275:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972096 00000100:00100000:3.0:1788875115.929286:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972096 00000100:00100000:3.0:1788875115.929349:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1788875115.929361:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:10421:x1875771217972096:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875115.929385:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875115.929407:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d826bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bd7 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875115.929525:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788875115.930063:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d826bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bd7 expref: 13 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.930079:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875115.930082:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875115.930089:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d826bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bd7 expref: 13 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875115.930103:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875115.930273:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10421:x1875771217972096:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 914us (1178us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788875115.930281:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1788875115.936204:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875115.936295:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972224 00000100:00100000:2.0:1788875115.936305:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972224 00000100:00100000:2.0:1788875115.936406:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:2.0:1788875115.936417:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10421:x1875771217972224:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1788875115.936493:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936510:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936522:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936539:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936547:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936553:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936896:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936906:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936914:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875115.936952:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936963:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936976:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936983:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.936989:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875115.936994:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937001:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937014:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875115.937017:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875115.937022:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937028:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937040:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937045:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937050:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937055:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875115.937063:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937070:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937077:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045bae00) 00010000:00010000:2.0:1788875115.937079:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875115.937082:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937088:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937102:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937108:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937113:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937118:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875115.937121:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937126:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937133:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875115.937135:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875115.937143:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875115.937148:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875115.937216:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10421:x1875771217972224:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 801us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875115.937223:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:0.0:1788875115.941128:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875115.941257:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972480 00000100:00100000:3.0:1788875115.941278:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972480 00000100:00100000:3.0:1788875115.941326:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875115.941335:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10421:x1875771217972480:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875115.941924:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10421:x1875771217972480:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 587us (803us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788875115.941933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1788875116.001578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.002013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972736 00000100:00100000:2.0:1788875116.002023:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972736 00000100:00100000:2.0:1788875116.002082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:2.0:1788875116.002092:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10424:x1875771217972736:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875116.002116:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875116.002144:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bde expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002246:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002268:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002286:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002294:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002630:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d826f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002639:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d826f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.002647:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d826f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875116.002656:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788875116.002766:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003074:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003082:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003088:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875116.003093:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003101:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003113:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875116.003116:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875116.003131:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003138:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d826e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003153:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003302:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003309:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003314:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875116.003318:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003324:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003333:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045bae00) 00010000:00010000:2.0:1788875116.003336:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875116.003339:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003345:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d826ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003395:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d826e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bde expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003422:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d826f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bde expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.003429:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875116.003431:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875116.003434:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:2.0:1788875116.003496:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10424:x1875771217972736:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1405us (1926us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788875116.003504:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:2.0:1788875116.015105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875116.015470:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972864 00000100:00100000:0.0:1788875116.015482:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972864 00000100:00100000:0.0:1788875116.015557:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:0.0:1788875116.015568:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:2347:x1875771217972864:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875116.015583:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875116.015607:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d826f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bde expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.015627:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:0.0:1788875116.015632:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875116.015707:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2347:x1875771217972864:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 139us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875116.015715:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:0.0:1788875116.018418:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.020169:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217972992 00000100:00100000:2.0:1788875116.020184:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217972992 00000100:00100000:2.0:1788875116.020504:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:2.0:1788875116.020517:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10424:x1875771217972992:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1788875116.020588:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020616:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020628:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020655:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020663:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020694:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020700:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875116.020705:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020712:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020724:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875116.020727:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875116.020731:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.020737:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875116.020855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10424:x1875771217972992:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 340us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.020862:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:1.0:1788875116.025341:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875116.025440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217973248 00000100:00100000:3.0:1788875116.025453:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217973248 00000100:00100000:3.0:1788875116.025509:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1788875116.025519:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10424:x1875771217973248:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875116.025977:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10424:x1875771217973248:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 458us (646us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788875116.025986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00010000:00010000:0.0:1788875116.302833:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875116.322116:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875116.322176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875116.322218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875116.322317:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217973376 00000100:00100000:1.0:1788875116.322337:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217973376 00000100:00100000:1.0:1788875116.322417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 288 00000100:00100000:1.0:1788875116.322428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217973376:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875116.322719:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217973632 00000100:00100000:2.0:1788875116.322725:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217973632 00000100:00100000:3.0:1788875116.322766:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217973504 00000100:00100000:2.0:1788875116.322823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:3.0:1788875116.322827:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217973504 00000100:00100000:2.0:1788875116.322836:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217973632:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:0.0:1788875116.322925:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875116.322931:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875116.322977:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:0.0:1788875116.322990:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217973504:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875116.323083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217973376:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 654us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875116.323097:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 288 00000100:00100000:2.0:1788875116.328199:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217973632:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 5355us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.328215:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:0.0:1788875116.331707:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217973504:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 8331us (9218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875116.331728:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1788875116.341189:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.341752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217973888 00000100:00100000:2.0:1788875116.341766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217973888 00000100:00100000:2.0:1788875116.341864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:2.0:1788875116.341875:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10442:x1875771217973888:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1788875116.341908:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875116.341937:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8270a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0be5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.342067:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82711 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.342085:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82711 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.342099:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82711 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875116.342111:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788875116.342274:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8270a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0be5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.342299:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82711 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0be5 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.342309:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:2.0:1788875116.342313:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788875116.342317:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:2.0:1788875116.342425:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10442:x1875771217973888:12345-192.168.202.7@tcp:101:cat.0 Request processed in 551us (1251us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788875116.342457:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1788875116.366381:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241069440:0@lo:400:kworker.0 00000100:00100000:0.0:1788875116.366820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875116.367155:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788875116.367165:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241069312:0@lo:400:kworker.0 00000100:00100000:0.0:1788875116.367213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875116.367235:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241069824:0@lo:400:kworker.0 00000100:00100000:0.0:1788875116.367266:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875116.367318:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069440 00000100:00100000:0.0:1788875116.367340:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069440 00000100:00100000:3.0:1788875116.367720:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069312 00000100:00100000:3.0:1788875116.367725:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069312 00000100:00100000:3.0:1788875116.367804:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788875116.367815:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875116.367900:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241069312:12345-0@lo:400:kworker.0 Request processed in 86us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875116.367908:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788875116.367941:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069824 00000100:00100000:3.0:1788875116.367945:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069824 00000100:00100000:3.0:1788875116.367973:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788875116.367978:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241069824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875116.368029:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241069824:12345-0@lo:400:kworker.0 Request processed in 51us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875116.368036:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788875116.368062:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875116.368068:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875116.368112:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241069312:0@lo:400:kworker.0 00000100:00100000:3.0:1788875116.368126:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241069824:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.368829:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241069184:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.368890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875116.368927:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241069696:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.368955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875116.368980:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875116.368987:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241069568:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.369013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875116.369047:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069568 00000100:00100000:2.0:1788875116.369053:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069568 00000100:00100000:2.0:1788875116.369090:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788875116.369098:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241069568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.369143:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241069568:12345-0@lo:400:kworker.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.369150:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788875116.369196:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241069568:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.369227:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069696 00000100:00100000:2.0:1788875116.369230:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069696 00000100:00100000:2.0:1788875116.369265:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788875116.369271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241069696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.369307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241069696:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.369314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788875116.369328:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875116.369597:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241069696:0@lo:400:kworker.0 00000100:00100000:0.0:1788875116.371000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069184 00000100:00100000:0.0:1788875116.371014:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069184 00000100:00100000:0.0:1788875116.371105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788875116.371129:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241069184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875116.371235:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241069184:12345-0@lo:400:kworker.0 Request processed in 109us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875116.371243:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788875116.371657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788875116.371678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875116.371741:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241069440:12345-0@lo:400:kworker.0 Request processed in 67us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875116.371747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788875116.371970:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241069440:0@lo:400:kworker.0 00000100:00100000:2.0:1788875116.372671:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241069184:0@lo:400:kworker.0 00000100:00100000:3.0:1788875116.406453:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.407144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974016 00000100:00100000:2.0:1788875116.407158:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974016 00000100:00100000:2.0:1788875116.407243:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:2.0:1788875116.407256:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10443:x1875771217974016:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875116.407292:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875116.407331:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8271f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.407698:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.407718:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.407732:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875116.408027:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788875116.408032:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875116.408057:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.408091:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8271f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bec expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.408114:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bec expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.408148:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875116.408151:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875116.408156:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875116.408233:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10443:x1875771217974016:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 980us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.408242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:1.0:1788875116.412376:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.412742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974400 00000100:00100000:2.0:1788875116.412755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974400 00000100:00100000:2.0:1788875116.412849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1788875116.412861:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10443:x1875771217974400:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875116.423877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10443:x1875771217974400:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 7721us (8221us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788875116.423910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875116.433061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875116.433171:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974528 00000100:00100000:1.0:1788875116.433186:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974528 00000100:00100000:1.0:1788875116.433271:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:1.0:1788875116.433284:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10443:x1875771217974528:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:1.0:1788875116.433307:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788875116.433356:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d826af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bd0 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875116.433389:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82711 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0be5 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875116.433402:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d825ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b91 expref: 17 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875116.433436:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903800) 00010000:00010000:1.0:1788875116.433460:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875116.433540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10443:x1875771217974528:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 259us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875116.433549:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1788875116.453688:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875116.454013:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974656 00000100:00100000:2.0:1788875116.454027:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974656 00000100:00100000:2.0:1788875116.454103:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:2.0:1788875116.454114:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10443:x1875771217974656:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:2.0:1788875116.454282:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.454303:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875116.454327:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875116.455227:0:8216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788875116.455437:0:8216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788875116.455500:0:8216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788875116.455642:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10443:x1875771217974656:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 1526us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875116.455654:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:2.0:1788875116.481879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875116.482031:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974784 00000100:00100000:0.0:1788875116.482046:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974784 00000100:00100000:0.0:1788875116.482122:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:0.0:1788875116.482135:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10445:x1875771217974784:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875116.482163:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875116.482193:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bf3 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482284:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482302:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482316:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482345:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482353:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875116.482359:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491623:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491651:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491678:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875116.491738:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788875116.491744:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875116.491788:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491824:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491835:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491841:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491849:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491855:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875116.491860:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.491870:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492341:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875116.492346:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875116.492352:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492361:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d8273b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492381:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492387:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492401:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492407:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875116.492410:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492416:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492425:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a0bc0dc00) 00010000:00010000:3.0:1788875116.492428:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875116.492432:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492438:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492496:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 18 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492513:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 17 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875116.492522:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875116.492524:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875116.492527:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875116.492632:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10445:x1875771217974784:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 10498us (10764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875116.492651:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1788875116.881615:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241069952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875116.881708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875116.881879:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241069952 00000100:00100000:0.0:1788875116.881889:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241069952 00000100:00100000:0.0:1788875116.881968:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788875116.881978:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241069952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875116.882015:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875116.882064:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241069952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875116.882071:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788875116.882128:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241069952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875117.328071:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788875117.452169:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788875117.452181:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788875117.452220:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788875117.452227:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788875117.461640:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875117.461648:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875117.461710:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788875117.461716:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788875117.461850:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241070080:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788875117.461941:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875117.471464:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241070080:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788875117.476002:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.476221:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217974912 00000100:00100000:2.0:1788875117.476231:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217974912 00000100:00100000:2.0:1788875117.476288:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:2.0:1788875117.476297:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217974912:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788875117.476375:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217974912:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 Request processed in 79us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875117.476383:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00080000:1.0:1788875117.476876:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875117.488925:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.489182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217975040 00000100:00100000:3.0:1788875117.489191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217975040 00000100:00100000:3.0:1788875117.489279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:3.0:1788875117.489290:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217975040:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875117.489331:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788875117.489438:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217975040:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 150us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.489447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:2.0:1788875117.495020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.495252:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217975168 00000100:00100000:3.0:1788875117.495262:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217975168 00000100:00100000:3.0:1788875117.495360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:3.0:1788875117.495371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217975168:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.495445:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495475:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495491:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495518:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495544:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495565:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495572:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875117.495607:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788875117.495611:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875117.495626:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495636:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495642:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495648:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495664:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.495668:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495681:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495693:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:3.0:1788875117.495696:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875117.495700:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495707:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82750 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495720:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495725:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495731:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495736:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.495739:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495745:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495753:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e5a10903100) 00010000:00010000:3.0:1788875117.495756:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875117.495759:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495828:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82757 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495842:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495847:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495853:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495858:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.495861:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495867:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495875:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875117.495877:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875117.495880:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.495885:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d8275e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.495956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217975168:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 587us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.495964:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:2.0:1788875117.499930:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.500200:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217975424 00000100:00100000:3.0:1788875117.500210:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217975424 00000100:00100000:3.0:1788875117.500265:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:3.0:1788875117.500274:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217975424:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.500291:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875117.500318:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82765 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0bfa expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.500410:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.500424:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.500434:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875117.500445:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788875117.501216:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501227:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501234:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501240:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.501244:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501251:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501271:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875117.501273:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875117.501278:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.501284:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d8276c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.501442:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82765 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bfa expref: 19 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.501466:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:2.0:1788875117.501468:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875117.501472:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82765 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bfa expref: 19 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.501483:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:2.0:1788875117.501556:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217975424:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1283us (1635us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788875117.501564:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:3.0:1788875117.507267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.507298:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217975552 00000100:00100000:3.0:1788875117.507307:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217975552 00000100:00100000:3.0:1788875117.507368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:3.0:1788875117.507378:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217975552:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875117.507413:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788875117.507535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217975552:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 158us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.507543:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:0.0:1788875117.513097:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.515727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217975808 00000100:00100000:3.0:1788875117.515740:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217975808 00000100:00100000:3.0:1788875117.515826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:3.0:1788875117.515838:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217975808:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.515860:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875117.515864:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788875117.515889:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bec expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.515907:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875117.515921:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875117.515936:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d8277a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c01 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875117.518959:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788875117.520508:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c2400/0x60858e6020d82781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.520526:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c2400/0x60858e6020d82781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.520536:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c2400/0x60858e6020d82781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.520974:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c3a00/0x60858e6020d8277a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c01 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.520994:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c2400/0x60858e6020d82781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c01 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.521002:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a10903100) 00010000:00010000:3.0:1788875117.521005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875117.521008:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a421c2400, rc 0) 00000100:00100000:3.0:1788875117.521535:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10456:x1875771217975808:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5697us (8447us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788875117.521545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:3.0:1788875117.527315:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875117.527411:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976064 00000100:00100000:0.0:1788875117.527422:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976064 00000100:00100000:0.0:1788875117.527480:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:0.0:1788875117.527491:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10456:x1875771217976064:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875117.527559:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875117.527586:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a421c2400/0x60858e6020d82781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c01 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527608:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a10903100) 00010000:00010000:0.0:1788875117.527621:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875117.527647:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527675:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527704:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527719:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527726:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527733:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527965:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527973:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527979:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527985:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875117.527989:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.527996:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528006:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875117.528008:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875117.528012:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528024:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d8278f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528034:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528039:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528044:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528049:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875117.528051:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528056:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528063:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaa039743 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875117.528065:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875117.528067:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.528073:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa039743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.528455:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217976064:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 961us (1146us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788875117.528464:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:3.0:1788875117.535335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875117.535427:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976192 00000100:00100000:0.0:1788875117.535439:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976192 00000100:00100000:0.0:1788875117.535494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:0.0:1788875117.535506:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10456:x1875771217976192:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875117.535536:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875117.535572:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d8279d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c08 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535610:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535623:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535732:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d8279d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535751:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.535760:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875117.535763:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788875117.535767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1e00, rc 0) 00000100:00100000:0.0:1788875117.543273:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10456:x1875771217976192:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7757us (7936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875117.543287:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:0.0:1788875117.548889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.548957:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976448 00000100:00100000:3.0:1788875117.548972:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976448 00000100:00100000:3.0:1788875117.549024:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:3.0:1788875117.549033:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10456:x1875771217976448:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.549110:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.549128:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.549141:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875117.549443:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788875117.549586:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332414813397ns, next at 333414810595ns, rc = 0 00000004:00010000:3.0:1788875117.549678:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061326003 reply state 00000000ced59e47 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.549688:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788875117.549812:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10456:x1875771217976448:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 779us (931us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788875117.549821:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 75 00010000:00010000:3.0:1788875117.555675:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555693:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555701:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555707:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.555721:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555729:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555747:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:3.0:1788875117.555750:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788875117.555755:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.555761:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d827ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875117.558815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.559044:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976576 00000100:00100000:3.0:1788875117.559055:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976576 00000100:00100000:3.0:1788875117.559106:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:3.0:1788875117.559116:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:10456:x1875771217976576:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.559141:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875117.559163:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c0f expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.559228:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 21 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.559244:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 21 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.559263:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:3.0:1788875117.559266:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875117.559282:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788875117.559349:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10456:x1875771217976576:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 235us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.559356:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1788875117.568701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.568748:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976704 00000100:00100000:3.0:1788875117.568759:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976704 00000100:00100000:3.0:1788875117.568826:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:3.0:1788875117.568835:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875771217976704:12345-192.168.202.7@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788875117.568865:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1788875117.568903:0:6694:0:(genops.c:1385:class_connect()) connect: client dd989c2b-3da6-48fe-ae0a-99ed44fd91eb, cookie 0x60858e6020d827b9 00002000:00100000:3.0:1788875117.568915:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd989c2b-3da6-48fe-ae0a-99ed44fd91eb/ffff9e5a06244000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788875117.568938:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788875117.569165:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788875117.569192:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9e5a06241000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788875117.569263:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2346:x1875771217976704:12345-192.168.202.7@tcp:8:lhsmtool_posix.0 Request processed in 428us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.569271:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1788875117.585722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875117.586231:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217976832 00000100:00100000:1.0:1788875117.586241:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217976832 00000100:00100000:1.0:1788875117.586373:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:1.0:1788875117.586386:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:0:x1875771217976832:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788875117.589432:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875117.637260:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:0:x1875771217976832:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 50865us (51535us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788875117.637275:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000001:00080000:1.0:1788875117.637315:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788875117.637325:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000100:00100000:0.0:1788875117.650529:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.650662:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977088 00000100:00100000:3.0:1788875117.650674:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977088 00000100:00100000:3.0:1788875117.650767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875117.650806:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10456:x1875771217977088:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788875117.651021:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10456:x1875771217977088:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 217us (503us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788875117.651029:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:1.0:1788875117.654582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875117.654701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977344 00000100:00100000:0.0:1788875117.654710:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977344 00000100:00100000:0.0:1788875117.654759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:0.0:1788875117.654798:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10456:x1875771217977344:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788875117.654901:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10456:x1875771217977344:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875117.654909:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:0.0:1788875117.658997:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.659088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977472 00000100:00100000:2.0:1788875117.659100:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977472 00000100:00100000:2.0:1788875117.659273:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:2.0:1788875117.659284:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10456:x1875771217977472:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875117.659517:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875117.659541:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c16 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659690:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659704:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659715:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875117.659766:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875117.659854:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659881:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c16 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659897:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c16 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.659905:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:2.0:1788875117.659908:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788875117.659911:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:2.0:1788875117.659979:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10456:x1875771217977472:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 696us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875117.659987:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:2.0:1788875117.663969:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.664058:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977600 00000100:00100000:3.0:1788875117.664081:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977600 00000100:00100000:3.0:1788875117.664151:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788875117.664162:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2349:x1875771217977600:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.664179:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875117.664203:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c1d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875117.664232:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0116d, blocks: 0x1 00010000:00010000:3.0:1788875117.664250:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1788875117.664256:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875117.664266:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.664289:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.664314:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788875117.664376:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2349:x1875771217977600:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 216us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.664384:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:1.0:1788875117.669816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.669875:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977856 00000100:00100000:3.0:1788875117.669887:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977856 00000100:00100000:3.0:1788875117.669995:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:3.0:1788875117.670005:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10456:x1875771217977856:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788875117.670106:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10456:x1875771217977856:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.670141:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:0.0:1788875117.674671:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.674795:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217977984 00000100:00100000:3.0:1788875117.674806:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217977984 00000100:00100000:3.0:1788875117.674866:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1788875117.674876:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:10456:x1875771217977984:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.674897:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875117.674917:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c24 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.674951:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.674961:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875117.674965:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875117.674971:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.675007:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.675021:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.675035:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875771241070208:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875117.675236:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f07cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875117.680046:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875771241070208:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875117.680084:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.680115:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875117.680243:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:10456:x1875771217977984:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5367us (5593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.680253:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:1.0:1788875117.683669:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.683808:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978112 00000100:00100000:2.0:1788875117.683819:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978112 00010000:00010000:2.0:1788875117.683858:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875117.683902:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1788875117.683913:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05656850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217978112:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875117.683926:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875117.683947:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.683970:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.683990:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000057104e7/0x60858e6020d827ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c1d expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.684003:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875117.684006:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875117.684013:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.684019:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.684047:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875117.684058:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875771241070336:192.168.202.7@tcp:105: 00000100:00100000:2.0:1788875117.684129:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875117.688807:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1875771241070336:192.168.202.7@tcp:105: 00010000:00010000:2.0:1788875117.688835:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875117.688890:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05656850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217978112:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 4979us (5238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875117.688901:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:1.0:1788875117.690922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.690981:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978240 00000100:00100000:2.0:1788875117.690994:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978240 00002000:00100000:2.0:1788875117.691037:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e5a3cdbdf80 x1875771217978240/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:23/0 lens 504/0 e 0 to 0 dl 1788875128 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875117.691045:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3cdbdf80 with x1875771217978240 ext(0->8) 00002000:00010000:2.0:1788875117.691049:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3cdbdf80 00000100:00100000:2.0:1788875117.691074:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1788875117.691080:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217978240:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788875117.691748:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771217978240:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 660us (828us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788875117.691757:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00002000:00100000:2.0:1788875117.691764:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e5a3cdbdf80 x1875771217978240/t4294967302(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:23/0 lens 504/448 e 0 to 0 dl 1788875128 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875117.691810:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3cdbdf80 with x1875771217978240 ext(0->8) 00002000:00010000:2.0:1788875117.691813:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3cdbdf80 00000100:00100000:0.0:1788875117.694059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.694345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978368 00000100:00100000:3.0:1788875117.694355:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978368 00000100:00100000:3.0:1788875117.694416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:3.0:1788875117.694426:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10456:x1875771217978368:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788875117.724314:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10456:x1875771217978368:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 29877us (30252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875117.724328:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00000020:00080000:1.0:1788875117.724472:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788875117.724503:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1788875117.724514:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788875117.724521:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788875117.724709:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788875117.724721:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788875117.725430:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241070464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788875117.725500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875117.725684:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241070464 00000100:00100000:3.0:1788875117.725692:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241070464 00000100:00100000:3.0:1788875117.725752:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788875117.725760:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241070464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788875117.725955:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788875117.725959:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788875118 00002000:00010000:3.0:1788875117.725962:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788875117.725964:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788875117 -> 1788875118 00002000:00010000:3.0:1788875117.725967:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788875117.726010:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241070464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (510us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788875117.726017:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788875117.726090:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788875117.726512:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a3d02c000/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788875117.726519:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241070464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788875117.728962:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875117.729048:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978496 00000100:00100000:1.0:1788875117.729056:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978496 00000100:00100000:1.0:1788875117.729153:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1788875117.729164:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771217978496:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788875117.755769:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788875117.755802:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788875117.755924:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217978496:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 26757us (26966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.755945:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:3.0:1788875117.758218:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.758290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978752 00000100:00100000:2.0:1788875117.758300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978752 00000100:00100000:2.0:1788875117.758361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:2.0:1788875117.758370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10456:x1875771217978752:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788875117.758417:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875117.758438:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d827c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c16 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.758453:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:2.0:1788875117.758457:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875117.758491:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.758506:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.758516:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875117.758904:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071a650b7 reply state 00000000951cde1d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875117.758912:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875117.758997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10456:x1875771217978752:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 628us (786us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788875117.759002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00010000:00010000:3.0:1788875117.760814:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760831:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760839:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760844:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.760849:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760857:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760871:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:3.0:1788875117.760874:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875117.760878:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.760883:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d827dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.762507:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875117.762666:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217978880 00000100:00100000:1.0:1788875117.762676:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217978880 00000100:00100000:1.0:1788875117.762725:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:1.0:1788875117.762733:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217978880:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788875117.762946:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788875117.762949:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788875118 -> 1788875116 00002000:00010000:1.0:1788875117.762951:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788875114 00002000:00010000:1.0:1788875117.762952:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788875118 -> 1788875116 00002000:00010000:1.0:1788875117.762954:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788875117.762995:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217978880:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 263us (500us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788875117.763011:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:1.0:1788875117.765159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.765218:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979136 00000100:00100000:3.0:1788875117.765226:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979136 00000100:00100000:3.0:1788875117.765268:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:3.0:1788875117.765275:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10456:x1875771217979136:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788875117.765348:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.765365:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.765374:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.765410:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.765421:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 13 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.765432:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241070592:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875117.765506:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f07240 going to sleep for 11 seconds 00000100:00100000:0.0:1788875117.768193:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.768263:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241070592:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875117.768283:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.768349:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979264 00000100:00100000:1.0:1788875117.768357:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979264 00010000:00010000:1.0:1788875117.768393:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.768427:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:1.0:1788875117.768434:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2348:x1875771217979264:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875117.768446:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875117.768451:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768460:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768475:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c08 expref: 14 pid: 5842 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768488:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:1.0:1788875117.768491:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768497:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.768532:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875117.768582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2348:x1875771217979264:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 149us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875117.768587:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00010000:00010000:3.0:1788875117.768941:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.768947:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.768971:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.768985:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.768990:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.768993:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.768996:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.769001:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.769008:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:3.0:1788875117.769010:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788875117.769012:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.769016:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d827e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.769050:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10456:x1875771217979136:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 3776us (3899us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788875117.769055:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1788875117.771421:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.771496:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979392 00000100:00100000:3.0:1788875117.771504:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979392 00000100:00100000:1.0:1788875117.771611:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:1.0:1788875117.771621:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771217979392:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788875117.771675:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.771695:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.771703:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875117.771707:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788875117.771712:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.771748:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.771762:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 7 pid: 6696 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.771805:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875771241070720:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875117.771887:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788875117.777034:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875771241070720:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875117.777059:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875117.777304:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875117.777757:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979520 00000100:00100000:3.0:1788875117.777765:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979520 00010000:00010000:3.0:1788875117.777830:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 8 pid: 6696 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.777870:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:3.0:1788875117.777880:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217979520:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875117.777894:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875117.777916:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 8 pid: 6696 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.777927:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 8 pid: 6696 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.777948:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7c93fc/0x60858e6020d827d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c24 expref: 8 pid: 6696 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.777963:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875117.777967:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875117.777973:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.777983:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.778029:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875117.778064:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778073:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.778086:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217979520:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 207us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.778092:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00010000:00010000:1.0:1788875117.778097:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778105:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778113:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778120:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875117.778125:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778134:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778145:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.778152:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7f748e/0x60858e6020d827ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.778214:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217979392:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 6594us (6799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875117.778223:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:1.0:1788875117.780580:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875117.780693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979776 00000100:00100000:0.0:1788875117.780702:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979776 00000100:00100000:0.0:1788875117.780754:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:0.0:1788875117.780764:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:10456:x1875771217979776:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788875117.780864:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.780894:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.780904:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.781070:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.781077:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 13 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.781083:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.781164:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 13 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.781174:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 13 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875117.781185:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241070848:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875117.781252:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bff23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875117.784238:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875117.784886:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217979904 00000100:00100000:1.0:1788875117.784897:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217979904 00010000:00010000:1.0:1788875117.784935:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 14 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.784978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:1.0:1788875117.784988:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2347:x1875771217979904:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875117.785003:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875117.785009:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 14 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.785022:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 14 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.785044:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:1.0:1788875117.785050:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.785060:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.785068:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.785096:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875117.785156:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2347:x1875771217979904:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 169us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875117.785163:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00010000:00010000:0.0:1788875117.787489:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d827b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c0f expref: 13 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875117.787516:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241070848:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875117.787538:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.787679:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.787685:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875117.787967:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788875117.788125:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788875117.788167:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788875117.788248:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875771241070976:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788875117.789269:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875117.790256:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241070976 00000100:00100000:3.0:1788875117.790267:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241070976 00000100:00100000:3.0:1788875117.790344:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788875117.790355:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875771241070976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788875117.790463:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875771241070976:12345-0@lo:1000:mdt00_001.0 Request processed in 110us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875117.790470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788875117.790718:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bff2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788875117.790744:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788875117.790749:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a3d02c000, transno 4294967303 00000100:00100000:0.0:1788875117.790761:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875771241070976:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788875117.793083:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788875117.793177:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875771241071104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788875117.794800:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875117.794852:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788875117.794974:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241071104 00000100:00100000:3.0:1788875117.794982:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241071104 00000100:00100000:3.0:1788875117.795040:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875117.795051:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875771241071104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788875117.795539:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875771241071104:12345-0@lo:1000:mdt00_001.0 Request processed in 489us (745us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788875117.795613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788875117.795816:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d02d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875771241071104:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788875117.795856:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795867:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795875:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795881:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875117.795886:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795895:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795911:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a0bc0d800) 00010000:00010000:1.0:1788875117.795914:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788875117.795920:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d827f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795969:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795990:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.795997:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796002:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875117.796005:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796011:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796020:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875117.796022:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788875117.796025:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796031:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8272d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796054:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796070:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 16 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796079:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796125:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 16 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875117.796147:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 16 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875117.796161:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241071232:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875117.796244:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788875117.800289:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241071232:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875117.801212:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.801731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875117.802221:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217980032 00000100:00100000:0.0:1788875117.802231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217980032 00010000:00010000:0.0:1788875117.802270:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 17 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875117.802420:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1788875117.802430:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:2348:x1875771217980032:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875117.802511:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875117.802530:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 17 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802699:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 17 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802725:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0bf3 expref: 17 pid: 11390 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802742:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:0.0:1788875117.802748:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802758:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802765:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.802821:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875117.802877:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:2348:x1875771217980032:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 448us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875117.802885:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00010000:00010000:3.0:1788875117.803145:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803154:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803166:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803180:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803186:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803191:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.803195:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803203:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803213:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875117.803215:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875117.803219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803225:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d827ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803236:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803242:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803247:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803252:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875117.803260:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803267:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803275:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875117.803277:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788875117.803280:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875117.803285:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d827f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875117.803526:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10456:x1875771217979776:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 22763us (22951us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788875117.803536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000020:00080000:3.0:1788875117.803540:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788875117.803741:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875117.803746:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788875117.803806:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788875117.803812:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788875117.806936:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875117.807064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217980288 00000100:00100000:2.0:1788875117.807075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217980288 00000100:00100000:2.0:1788875117.807142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:2.0:1788875117.807153:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10456:x1875771217980288:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788875117.808612:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788875117.808734:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788875117.809434:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.809511:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.809523:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.809997:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.810005:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.810012:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875117.810075:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788875117.810202:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10456:x1875771217980288:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 3046us (3271us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788875117.810212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000020:00080000:2.0:1788875117.810218:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788875117.810734:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875117.810742:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.810764:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875117.812219:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.812243:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.812262:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875117.812265:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788875117.812270:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.812277:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82806 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875117.812400:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875117.812403:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875117.812405:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875118.349920:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788875119.328908:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875119.328919:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875119.328959:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788875119.328966:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788875119.373993:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788875119.546235:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788875119.588833:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.588948:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217980544 00000100:00100000:1.0:1788875119.588958:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217980544 00000100:00100000:1.0:1788875119.589033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:1.0:1788875119.589044:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:10474:x1875771217980544:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875119.589067:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875119.589089:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d8280d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c2b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788875119.589223:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788875119.589332:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.589349:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.589361:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875119.589384:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788875119.589506:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d8280d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c2b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.589522:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c2b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.589543:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:1.0:1788875119.589546:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788875119.589550:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27800, rc 0) 00000100:00100000:1.0:1788875119.589623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10474:x1875771217980544:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 582us (799us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788875119.589638:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:1.0:1788875119.602950:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875119.604226:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217980672 00000100:00100000:3.0:1788875119.604240:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217980672 00000100:00100000:3.0:1788875119.604340:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:3.0:1788875119.604350:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10474:x1875771217980672:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:3.0:1788875119.604439:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604458:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604483:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604500:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604507:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604514:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604754:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604762:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604769:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875119.604823:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604834:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604841:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604848:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604862:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875119.604867:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604874:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604886:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875119.604889:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875119.604893:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604900:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604910:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604916:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604922:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604927:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875119.604929:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604935:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604951:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10903600) 00010000:00010000:3.0:1788875119.604954:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875119.604957:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604962:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604976:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.604995:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.605001:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.605006:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875119.605009:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.605015:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.605022:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10903c00) 00010000:00010000:3.0:1788875119.605024:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875119.605027:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.605032:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875119.605117:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10474:x1875771217980672:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 767us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875119.605125:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:3.0:1788875119.663335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.663468:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217980928 00000100:00100000:1.0:1788875119.663479:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217980928 00000100:00100000:1.0:1788875119.663548:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:1.0:1788875119.663560:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10477:x1875771217980928:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875119.663587:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875119.663615:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82837 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c32 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663717:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663735:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663765:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663828:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.663845:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664133:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664143:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664150:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875119.664162:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788875119.664258:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664267:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664274:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664280:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875119.664292:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664299:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664312:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:1.0:1788875119.664315:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875119.664320:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d8283e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664339:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664346:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664352:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664356:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875119.664359:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664364:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664370:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10bf8e00) 00010000:00010000:1.0:1788875119.664372:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875119.664381:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664387:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d82845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664438:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82837 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664452:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.664458:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875119.664460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875119.664463:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26600, rc 0) 00000100:00100000:1.0:1788875119.664528:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10477:x1875771217980928:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 970us (1206us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788875119.664537:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:2.0:1788875119.669754:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.671357:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217981056 00000100:00100000:1.0:1788875119.671371:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217981056 00000100:00100000:1.0:1788875119.671440:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:1.0:1788875119.671452:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10477:x1875771217981056:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1788875119.671517:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671536:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671549:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671605:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671612:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671618:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671623:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875119.671627:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671643:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671654:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875119.671658:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875119.671663:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.671668:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d8285a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875119.671751:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10477:x1875771217981056:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 301us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875119.671758:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1788875119.676807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.676925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217981312 00000100:00100000:1.0:1788875119.676935:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217981312 00000100:00100000:1.0:1788875119.676985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1788875119.677008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10477:x1875771217981312:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1788875119.677251:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10477:x1875771217981312:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 245us (493us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788875119.677260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875119.736620:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875119.737000:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217981568 00000100:00100000:0.0:1788875119.737010:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217981568 00000100:00100000:0.0:1788875119.737075:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:0.0:1788875119.737086:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:9997:x1875771217981568:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875119.737113:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875119.737136:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82861 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c39 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.737255:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.737287:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.737296:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.738507:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.738527:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 23 pid: 5842 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875119.738544:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241071360:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875119.738662:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a057b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788875119.767542:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241071360:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875119.767598:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875119.772125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.772304:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217981696 00000100:00100000:1.0:1788875119.772326:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217981696 00010000:00010000:1.0:1788875119.772373:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 24 pid: 5842 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875119.772421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:1.0:1788875119.772432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:2348:x1875771217981696:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875119.772449:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875119.772456:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 24 pid: 5842 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.772472:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 24 pid: 5842 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.772499:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8284c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c32 expref: 24 pid: 5842 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.772519:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875119.772524:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.772534:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.772553:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.773711:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875119.773815:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:2348:x1875771217981696:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 1379us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875119.773826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00010000:00010000:0.0:1788875119.774271:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.774283:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875119.774305:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788875119.774466:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82861 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 24 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.774502:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 23 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.774510:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:0.0:1788875119.774513:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788875119.774516:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0e00, rc 0) 00000100:00100000:0.0:1788875119.774549:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:9997:x1875771217981568:12345-192.168.202.7@tcp:101:bash.0 Request processed in 37466us (37941us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788875119.774556:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:3.0:1788875119.784589:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.784708:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217981952 00000100:00100000:1.0:1788875119.784720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217981952 00000100:00100000:1.0:1788875119.784815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:1.0:1788875119.784826:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:9997:x1875771217981952:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:1.0:1788875119.785131:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.785153:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.785166:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788875119.785220:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788875119.785244:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a950aad reply state 00000000ee6ce8a1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875119.785253:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788875119.785300:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788875119.785422:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:9997:x1875771217981952:12345-192.168.202.7@tcp:36:bash.0 Request processed in 596us (841us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788875119.785430:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000020:00080000:1.0:1788875119.785448:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788875119.789051:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789069:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789077:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789083:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875119.789088:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789096:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789113:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:3.0:1788875119.789116:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875119.789121:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.789127:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d82876 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875119.797695:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.800993:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982080 00000100:00100000:1.0:1788875119.801012:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982080 00000100:00100000:1.0:1788875119.801100:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:1.0:1788875119.801112:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:9997:x1875771217982080:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875119.801142:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875119.801165:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8287d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c40 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.801226:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8287d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c40 expref: 27 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.801242:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8287d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c40 expref: 27 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875119.801262:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875119.801265:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788875119.801269:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b26600, rc 0) 00000100:00100000:1.0:1788875119.801340:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:9997:x1875771217982080:12345-192.168.202.7@tcp:101:bash.0 Request processed in 231us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875119.801347:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:1.0:1788875119.813062:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875119.813229:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982208 00000100:00100000:3.0:1788875119.813239:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982208 00000100:00100000:3.0:1788875119.813321:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:3.0:1788875119.813334:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:9997:x1875771217982208:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875119.813351:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875119.813373:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c47 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875119.813404:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0116c, atime: 0x6aa0116a, ctime: 0x6aa0116c, blocks: 0xb 00010000:00010000:3.0:1788875119.813427:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788875119.813432:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875119.813441:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.813460:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875119.813473:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875119.813539:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:9997:x1875771217982208:12345-192.168.202.7@tcp:101:bash.0 Request processed in 208us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875119.813546:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00080000:0.0:1788875119.813683:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875119.822750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875119.828546:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982336 00000100:00100000:1.0:1788875119.828574:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982336 00002000:00010000:1.0:1788875119.828625:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788875119.828640:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d049880 with x1875771217982336 ext(0->18446744073709551615) 00002000:00010000:1.0:1788875119.828652:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d049880. 00000100:00100000:1.0:1788875119.828694:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1788875119.828718:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217982336:12345-192.168.202.7@tcp:10:bash.0 00002000:00010000:1.0:1788875119.829050:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788875119.829054:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788875116 -> 1788875120 00002000:00010000:1.0:1788875119.829057:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788875114 -> 1788875114 00002000:00010000:1.0:1788875119.829059:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788875116 -> 1788875120 00002000:00010000:1.0:1788875119.829061:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788875119.829143:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217982336:12345-192.168.202.7@tcp:10:bash.0 Request processed in 426us (6402us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788875119.829150:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00002000:00010000:1.0:1788875119.829154:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788875119.829157:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d049880 with x1875771217982336 ext(0->18446744073709551615) 00002000:00010000:1.0:1788875119.829162:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d049880. 00000100:00100000:1.0:1788875119.959429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875119.959519:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982464 00000100:00100000:0.0:1788875119.959530:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982464 00000100:00100000:0.0:1788875119.959599:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:0.0:1788875119.959609:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:10491:x1875771217982464:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:0.0:1788875119.959689:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.959704:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.959715:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.959728:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.959734:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.959753:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960004:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960014:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960021:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875119.960060:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960070:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960075:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960083:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960089:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875119.960093:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960099:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960111:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875119.960120:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875119.960126:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960133:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8288b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960144:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960152:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960157:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960161:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875119.960163:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960169:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960175:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875119.960177:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875119.960179:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960184:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960197:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960209:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960213:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960217:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875119.960220:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960225:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960231:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:0.0:1788875119.960233:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875119.960236:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875119.960242:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875119.960325:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:10491:x1875771217982464:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 717us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875119.960334:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:3.0:1788875120.021296:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.021506:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982720 00000100:00100000:1.0:1788875120.021517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982720 00000100:00100000:1.0:1788875120.021584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:1.0:1788875120.021595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:10494:x1875771217982720:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875120.021614:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875120.021664:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d828a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c4e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021733:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021748:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021761:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021826:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021834:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.021840:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022099:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d828b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022109:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d828b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022116:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d828b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875120.022139:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788875120.022228:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022236:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022244:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022250:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b26c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.022254:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022272:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022283:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:1.0:1788875120.022286:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875120.022292:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022298:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26c00/0x60858e6020d828a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022323:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022329:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022335:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022340:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.022343:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022348:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022356:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10bf8e00) 00010000:00010000:1.0:1788875120.022358:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875120.022361:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27200/0x60858e6020d828ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26800/0x60858e6020d828a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c4e expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022438:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d828b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c4e expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.022445:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875120.022448:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788875120.022451:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13b27e00, rc 0) 00000100:00100000:1.0:1788875120.022523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10494:x1875771217982720:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 930us (1237us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788875120.022531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:3.0:1788875120.028290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.028601:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217982848 00000100:00100000:1.0:1788875120.028611:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217982848 00000100:00100000:1.0:1788875120.028680:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1788875120.028691:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10494:x1875771217982848:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1788875120.028805:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.028822:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 29 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.028833:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.028947:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 29 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.028963:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 29 pid: 11390 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.028976:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241071488:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875120.029070:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788875120.033987:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241071488:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875120.034019:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.042326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.044823:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217983104 00000100:00100000:1.0:1788875120.044839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217983104 00000100:00100000:1.0:1788875120.044923:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:1.0:1788875120.044935:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:5589:x1875771217983104:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788875120.045606:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:5589:x1875771217983104:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 671us (3287us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788875120.045616:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1788875120.063268:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.063405:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217983232 00000100:00100000:3.0:1788875120.063414:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217983232 00010000:00010000:3.0:1788875120.063456:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 31 pid: 11390 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.063913:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875120.063926:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:2348:x1875771217983232:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875120.063943:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875120.063951:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 31 pid: 11390 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.063967:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 31 pid: 11390 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.063998:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82868 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c39 expref: 31 pid: 11390 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.064017:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:3.0:1788875120.064023:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.064031:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.064039:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.064069:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875120.064147:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:2348:x1875771217983232:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 224us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875120.064170:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00010000:00010000:1.0:1788875120.064243:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064251:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064283:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064298:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064304:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064322:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.064326:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064334:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064344:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875120.064347:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875120.064350:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.064355:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.064399:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10494:x1875771217982848:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 35710us (36119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875120.064406:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1788875120.076461:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.076923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217983488 00000100:00100000:3.0:1788875120.076934:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217983488 00000100:00100000:3.0:1788875120.077001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1788875120.077012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:10494:x1875771217983488:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875120.077505:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10494:x1875771217983488:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 494us (1054us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788875120.077513:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:2.0:1788875120.148391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.152077:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217983744 00000100:00100000:1.0:1788875120.152095:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217983744 00000100:00100000:2.0:1788875120.158111:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:2.0:1788875120.158133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+30:10505:x1875771217983744:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1788875120.158163:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875120.158187:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d828ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c55 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158292:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158309:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158323:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158338:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158346:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158353:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158705:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d828df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d828df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.158722:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d828df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875120.158732:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788875120.160979:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.160996:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161015:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161022:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875120.161027:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161035:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161050:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875120.161052:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875120.161056:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161063:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d828d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161078:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161084:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161090:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161095:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875120.161098:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161112:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161119:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045baf00) 00010000:00010000:2.0:1788875120.161121:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875120.161124:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161129:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d828d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d828ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c55 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161192:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d828df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c55 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.161199:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:2.0:1788875120.161201:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875120.161203:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875120.161279:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:10505:x1875771217983744:12345-192.168.202.7@tcp:101:cat.0 Request processed in 3155us (12899us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788875120.161288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:1.0:1788875120.172204:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.176030:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984000 00000100:00100000:3.0:1788875120.176046:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984000 00000100:00100000:3.0:1788875120.176124:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:3.0:1788875120.176135:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:10505:x1875771217984000:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:3.0:1788875120.176379:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10505:x1875771217984000:12345-192.168.202.7@tcp:35:cat.0 Request processed in 246us (4185us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788875120.176388:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:3.0:1788875120.236886:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.237699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984256 00000100:00100000:1.0:1788875120.237714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984256 00000100:00100000:1.0:1788875120.237869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:1.0:1788875120.237882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10506:x1875771217984256:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:1.0:1788875120.237947:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788875120.237974:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d828df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c55 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.237999:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27e00/0x60858e6020d828b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c4e expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26600/0x60858e6020d8287d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c40 expref: 31 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238021:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875120.238034:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875120.238056:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238070:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238092:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238106:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238112:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238118:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238352:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238361:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.238368:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788875120.238978:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788875120.238988:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335104214953ns, next at 336104212417ns, rc = 0 00010000:00010000:1.0:1788875120.239047:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239057:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239065:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239073:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239079:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239086:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239118:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875120.239136:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239148:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239154:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239160:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.239164:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239171:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239182:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8100) 00010000:00010000:1.0:1788875120.239185:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788875120.239189:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239195:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d828fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239211:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239217:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239223:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239228:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.239236:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239242:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239251:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:1.0:1788875120.239253:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875120.239257:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.239262:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d828ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875120.239271:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058267bc9 reply state 00000000d26e641d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.239279:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875120.239380:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:10506:x1875771217984256:12345-192.168.202.7@tcp:36:rm.0 Request processed in 1499us (2505us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788875120.239389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 95 00010000:00010000:2.0:1788875120.240188:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875120.240197:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.240205:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875120.240220:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.240230:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.240241:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e5a10bf8100) 00010000:00010000:2.0:1788875120.240244:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788875120.240247:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.240254:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82902 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.240275:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875120.240278:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875120.240280:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875120.252577:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252601:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252611:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252618:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.252632:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252676:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252699:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10bf8e00) 00010000:00010000:3.0:1788875120.252702:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875120.252710:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.252716:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d828f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.328406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.328521:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984512 00000100:00100000:1.0:1788875120.328535:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984512 00000100:00100000:1.0:1788875120.328622:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:1.0:1788875120.328644:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:10512:x1875771217984512:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875120.328674:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875120.328697:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82909 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c5c expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328848:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328879:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328891:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328907:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328915:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.328922:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875120.330021:0:8216:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788875120.330190:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330202:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330213:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330248:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330254:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330260:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330275:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.330279:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330286:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330297:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:1.0:1788875120.330300:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875120.330304:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330311:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82910 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875120.330323:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000395934e6 reply state 0000000023af3791 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.330332:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788875120.330363:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82909 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 34 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330377:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 33 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.330384:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:1.0:1788875120.330386:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875120.330388:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34e00, rc 0) 00000100:00100000:1.0:1788875120.330527:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:10512:x1875771217984512:12345-192.168.202.7@tcp:101:bash.0 Request processed in 1884us (2135us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788875120.330541:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 96 00010000:00010000:1.0:1788875120.333721:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333738:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333746:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333752:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875120.333757:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333765:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333805:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10bf8500) 00010000:00010000:1.0:1788875120.333808:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875120.333813:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.333819:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.339233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.339550:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984640 00000100:00100000:2.0:1788875120.339560:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984640 00000100:00100000:2.0:1788875120.339730:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:2.0:1788875120.339741:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771217984640:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1788875120.339761:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875120.339806:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c63 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875120.339835:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875120.339855:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788875120.339859:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875120.339869:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.339910:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.339924:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875120.340089:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217984640:12345-192.168.202.7@tcp:101:bash.0 Request processed in 342us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875120.340096:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00080000:0.0:1788875120.340199:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875120.344970:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.345056:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984768 00000100:00100000:3.0:1788875120.345068:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984768 00000100:00100000:3.0:1788875120.346058:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1788875120.346071:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:10512:x1875771217984768:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875120.346098:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875120.346119:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.346152:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.346162:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875120.346167:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875120.346173:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.346228:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.346243:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 7 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.346257:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241071616:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875120.346362:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875120.357501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.363174:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217984896 00000100:00100000:2.0:1788875120.363190:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217984896 00010000:00010000:2.0:1788875120.363240:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875120.363289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1788875120.363298:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05654c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217984896:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875120.363314:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875120.363339:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.363353:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 8 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.363379:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875120.363384:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875120.363393:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.363429:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.363470:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875120.363484:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241071744:192.168.202.7@tcp:105: 00000100:00100000:2.0:1788875120.363586:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875120.366536:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241071744:192.168.202.7@tcp:105: 00010000:00010000:2.0:1788875120.366574:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875120.366646:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05654c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217984896:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 3347us (9157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875120.366657:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00010000:00010000:1.0:1788875120.367162:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d8292c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c63 expref: 7 pid: 6696 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.367179:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241071616:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875120.367215:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.367230:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:1.0:1788875120.367272:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:10512:x1875771217984768:12345-192.168.202.7@tcp:101:bash.0 Request processed in 21205us (22314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875120.367279:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:3.0:1788875120.369238:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.369853:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217985152 00000100:00100000:1.0:1788875120.369868:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217985152 00000100:00100000:1.0:1788875120.369943:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:1.0:1788875120.369954:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:10512:x1875771217985152:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:1.0:1788875120.370314:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:10512:x1875771217985152:12345-192.168.202.7@tcp:35:bash.0 Request processed in 361us (1088us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788875120.370323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00010000:00010000:0.0:1788875120.399680:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875120.579183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.579358:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217985280 00000100:00100000:2.0:1788875120.579373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217985280 00000100:00100000:2.0:1788875120.579468:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:2.0:1788875120.579481:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:10528:x1875771217985280:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875120.579514:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875120.579542:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8293a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.579643:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.579965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.580002:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875120.580052:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788875120.580057:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875120.580079:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.580111:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d8293a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c71 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.580137:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c71 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.580147:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875120.580150:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875120.580154:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:2.0:1788875120.580245:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:10528:x1875771217985280:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 767us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875120.580254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:2.0:1788875120.607645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.607761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217985536 00000100:00100000:1.0:1788875120.607803:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217985536 00000100:00100000:1.0:1788875120.607889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:1.0:1788875120.607901:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:10528:x1875771217985536:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875120.607921:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875120.607944:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c78 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.608045:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8294f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.608060:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8294f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.608088:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8294f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875120.608101:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788875120.608231:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c78 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.608251:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8294f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c78 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.608260:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:1.0:1788875120.608263:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875120.608267:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34800, rc 0) 00000100:00100000:1.0:1788875120.608345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:10528:x1875771217985536:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 446us (725us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788875120.608353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:3.0:1788875120.612508:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.612678:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217985792 00000100:00100000:1.0:1788875120.612690:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217985792 00000100:00100000:1.0:1788875120.612759:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:1.0:1788875120.612800:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:10528:x1875771217985792:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875120.612829:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875120.612853:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d8295d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c7f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.612955:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.612989:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.613001:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875120.613017:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788875120.613146:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d8295d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c7f expref: 40 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.613165:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c7f expref: 39 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.613173:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:1.0:1788875120.613176:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788875120.613180:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34000, rc 0) 00000100:00100000:1.0:1788875120.613253:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:10528:x1875771217985792:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 485us (755us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788875120.613261:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:3.0:1788875120.613972:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875120.616317:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217985920 00000100:00100000:0.0:1788875120.616334:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217985920 00000100:00100000:0.0:1788875120.616430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1788875120.616440:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:2348:x1875771217985920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875120.616456:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875120.616482:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8294f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c78 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.616503:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:0.0:1788875120.616508:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875120.616589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:2348:x1875771217985920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 151us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.616598:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1788875120.618932:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.619023:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986048 00000100:00100000:1.0:1788875120.619034:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986048 00000100:00100000:1.0:1788875120.619096:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:1.0:1788875120.619106:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771217986048:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:1.0:1788875120.619152:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.619175:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.619198:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875120.619204:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788875120.619210:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.619251:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.619267:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 6 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.619281:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241071872:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875120.619388:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788875120.623669:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241071872:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875120.623702:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.633385:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.634720:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986176 00000100:00100000:3.0:1788875120.634733:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986176 00002000:00100000:3.0:1788875120.634829:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e5a3d048a80 x1875771217986176/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:26/0 lens 504/0 e 0 to 0 dl 1788875131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788875120.634840:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d048a80 with x1875771217986176 ext(0->8) 00010000:00010000:3.0:1788875120.634851:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 7 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.634890:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 7 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875120.634899:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d048a80 00000100:00100000:3.0:1788875120.634937:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1788875120.634947:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217986176:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:3.0:1788875120.636704:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2347:x1875771217986176:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 1750us (3322us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788875120.636716:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00002000:00100000:3.0:1788875120.636727:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e5a3d048a80 x1875771217986176/t4294967302(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:26/0 lens 504/448 e 0 to 0 dl 1788875131 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788875120.636737:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d048a80 with x1875771217986176 ext(0->8) 00010000:00010000:3.0:1788875120.636746:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.636763:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875120.636973:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d048a80 00000100:00100000:1.0:1788875120.639147:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875120.639237:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986304 00000100:00100000:0.0:1788875120.639246:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986304 00010000:00010000:0.0:1788875120.639284:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.639338:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:0.0:1788875120.639347:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771217986304:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875120.639363:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788875120.639383:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788875120.639386:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788875120 00002000:00010000:0.0:1788875120.639388:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788875121 00002000:00010000:0.0:1788875120.639390:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788875120 00010000:00010000:0.0:1788875120.639396:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.639428:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.639450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d82933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c6a expref: 9 pid: 6694 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.639467:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788875120.639472:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788875120.639478:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.639488:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.639761:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875120.639880:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639891:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639929:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639938:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639947:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639955:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875120.639959:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639981:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.639995:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.640003:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1781d85/0x60858e6020d82972 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.640088:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217986048:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 20983us (21162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875120.640095:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:0.0:1788875120.640166:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217986304:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 820us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.640174:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:0.0:1788875120.646599:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875120.648997:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986560 00000100:00100000:1.0:1788875120.649014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986560 00000100:00100000:1.0:1788875120.649096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:1.0:1788875120.649107:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:10528:x1875771217986560:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:1.0:1788875120.649177:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c7f expref: 38 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788875120.649470:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788875120.649513:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788875120.649904:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788875120.649956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.649980:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 42 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.649989:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.650027:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 42 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875120.650041:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 42 pid: 8216 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875120.650056:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875771241072000:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875120.650151:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788875120.653409:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875120.653482:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986688 00000100:00100000:0.0:1788875120.653492:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986688 00010000:00010000:0.0:1788875120.653548:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 43 pid: 8216 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.653608:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1788875120.653619:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:2348:x1875771217986688:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875120.653658:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875120.653666:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 43 pid: 8216 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.653682:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 43 pid: 8216 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.653706:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:0.0:1788875120.653712:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.653721:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.653729:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.653747:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875120.653835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:2348:x1875771217986688:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 217us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.653843:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00010000:00010000:3.0:1788875120.654297:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d8291e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c5c expref: 42 pid: 8216 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.654315:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875771241072000:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875120.654337:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.654347:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.654353:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875120.654478:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788875120.654698:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788875120.654831:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241072128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788875120.654904:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875120.654937:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bce56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875120.655333:0:11970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241072128 00000100:00100000:0.0:1788875120.655342:0:11970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241072128 00000100:00100000:0.0:1788875120.655398:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788875120.655407:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5845:x1875771241072128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788875120.655473:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5845:x1875771241072128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.655480:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788875120.657827:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875120.657909:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788875120.657918:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788875120.657942:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a3c58f100, transno 4294967301 00000100:00100000:3.0:1788875120.657963:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241072128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788875120.658512:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788875120.658635:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241072256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788875120.658710:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875120.658755:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875120.659534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241072256 00000100:00100000:2.0:1788875120.659543:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241072256 00000100:00100000:2.0:1788875120.659604:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788875120.659614:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875771241072256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788875120.659857:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875771241072256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 244us (1145us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788875120.659883:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788875120.660228:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875771241072256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788875120.660301:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788875120.662434:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662446:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662454:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662461:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.662465:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662473:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662492:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:3.0:1788875120.662494:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788875120.662499:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.662506:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82979 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875120.662762:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788875120.662922:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788875120.662934:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335528160940ns, next at 336528158676ns, rc = 0 00000001:00080000:3.0:1788875120.662941:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788875120.662974:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a10bf8300) 00010000:00010000:3.0:1788875120.662978:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788875120.663001:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c7f expref: 46 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.663148:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:10528:x1875771217986560:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 14041us (16558us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788875120.663159:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000020:00080000:3.0:1788875120.663165:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788875120.669286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875120.672769:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217986816 00000100:00100000:0.0:1788875120.672822:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217986816 00000100:00100000:0.0:1788875120.672889:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:0.0:1788875120.672900:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:10528:x1875771217986816:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875120.672929:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875120.672955:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c86 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.673017:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c86 expref: 46 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.673033:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c86 expref: 46 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.673051:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875120.673055:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875120.673059:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0000, rc 0) 00000100:00100000:0.0:1788875120.673151:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:10528:x1875771217986816:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 252us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.673159:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:0.0:1788875120.680184:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.680292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217987072 00000100:00100000:3.0:1788875120.680302:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217987072 00000100:00100000:3.0:1788875120.680367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:3.0:1788875120.680378:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:10528:x1875771217987072:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875120.680654:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10528:x1875771217987072:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 277us (479us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788875120.680662:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:2.0:1788875120.793144:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.793342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217987200 00000100:00100000:3.0:1788875120.793356:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217987200 00000100:00100000:3.0:1788875120.793498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:3.0:1788875120.793512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10538:x1875771217987200:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:3.0:1788875120.793634:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793657:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793673:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793693:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793726:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793735:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793916:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793926:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793933:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875120.793982:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.793998:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794005:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794012:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794018:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.794023:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794032:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875120.794055:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875120.794061:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794068:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794083:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794089:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794095:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794100:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.794103:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794109:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794117:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a10903400) 00010000:00010000:3.0:1788875120.794119:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875120.794122:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794128:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8298e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794154:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794160:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794165:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794170:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.794172:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794177:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794184:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875120.794186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875120.794189:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.794196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.794284:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10538:x1875771217987200:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 775us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875120.794291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:1.0:1788875120.828295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.828955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217987456 00000100:00100000:2.0:1788875120.828971:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217987456 00000100:00100000:2.0:1788875120.829043:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:2.0:1788875120.829052:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:10541:x1875771217987456:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875120.829075:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875120.829102:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8299c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829183:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829198:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829208:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829224:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829231:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829236:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829384:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829415:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829422:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875120.829435:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788875120.829565:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829572:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829577:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829581:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875120.829584:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829591:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829601:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:2.0:1788875120.829603:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875120.829607:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829611:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d829a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829658:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829673:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829679:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829683:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875120.829686:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829693:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829701:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045baa00) 00010000:00010000:2.0:1788875120.829704:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875120.829707:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829712:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d829aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.829761:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8299c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.830157:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.830166:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875120.830169:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875120.830181:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875120.830282:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+49:10541:x1875771217987456:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1222us (1998us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788875120.830292:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:0.0:1788875120.834913:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.835117:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217987584 00000100:00100000:3.0:1788875120.835131:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217987584 00000100:00100000:3.0:1788875120.835209:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:3.0:1788875120.835241:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+49:10541:x1875771217987584:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1788875120.835358:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835384:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835401:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835439:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835446:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835453:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835460:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.835465:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835473:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835486:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875120.835489:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875120.835495:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.835503:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.835606:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+49:10541:x1875771217987584:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 367us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875120.835614:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:3.0:1788875120.840394:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.840606:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217987840 00000100:00100000:2.0:1788875120.840631:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217987840 00000100:00100000:2.0:1788875120.840705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:2.0:1788875120.840717:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+49:10541:x1875771217987840:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875120.841073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:10541:x1875771217987840:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 357us (692us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788875120.841082:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:1.0:1788875120.931752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.931893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988096 00000100:00100000:3.0:1788875120.931908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988096 00000100:00100000:3.0:1788875120.932011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:3.0:1788875120.932024:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:10551:x1875771217988096:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875120.932059:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875120.932063:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788875120.932100:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c71 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932127:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875120.932134:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875120.932153:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c94 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932523:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932542:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932552:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932632:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.932651:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 50 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.932670:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241072384:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875120.932899:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a01254000 going to sleep for 11 seconds 00000100:00100000:1.0:1788875120.936193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.936407:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988224 00000100:00100000:2.0:1788875120.936424:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988224 00010000:00010000:2.0:1788875120.936486:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 51 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875120.936546:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1788875120.936559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:2347:x1875771217988224:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875120.936580:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875120.936589:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 51 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.936605:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 51 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.936646:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875120.936653:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.936672:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d829b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c8d expref: 51 pid: 5841 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.936681:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.936689:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875120.936692:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241072384:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875120.936710:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875120.936721:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.936731:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.936737:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875120.936761:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:2.0:1788875120.936820:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:2347:x1875771217988224:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 263us (642us total) trans 0 rc 0/0 00010000:00010000:3.0:1788875120.937001:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.937020:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.937039:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875120.937042:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875120.937045:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875120.937072:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:10551:x1875771217988096:12345-192.168.202.7@tcp:101:bash.0 Request processed in 5051us (5338us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788875120.937074:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:3.0:1788875120.937079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:1.0:1788875120.946533:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875120.947512:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988480 00000100:00100000:3.0:1788875120.947532:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988480 00000100:00100000:3.0:1788875120.947614:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 105 00000100:00100000:3.0:1788875120.947635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:10551:x1875771217988480:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:0.0:1788875120.948178:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.948204:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.948231:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875120.948316:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788875120.948344:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9f85cdd reply state 0000000048a0b908 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.948355:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875120.948501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:10551:x1875771217988480:12345-192.168.202.7@tcp:36:bash.0 Request processed in 865us (1982us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788875120.948511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 105 00000020:00080000:0.0:1788875120.948517:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788875120.951148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875120.951426:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988608 00000100:00100000:0.0:1788875120.951440:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988608 00000100:00100000:0.0:1788875120.951520:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:0.0:1788875120.951532:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:10551:x1875771217988608:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875120.951564:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875120.951595:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d829e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0c9b expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.951723:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.951743:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.953032:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.953045:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962830:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962855:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962865:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962872:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875120.962879:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962890:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962916:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875120.962920:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875120.962953:0:3289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875120.962967:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 3/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.969677:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.969703:0:11390:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1788875120.969706:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d829db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.969848:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.969871:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 53 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875120.969890:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d04aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241072512:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875120.970014:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a057b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788875120.974044:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241072640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875120.974640:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875120.974838:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241072640 00000100:00100000:0.0:1788875120.974850:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241072640 00000100:00100000:0.0:1788875120.974938:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788875120.974950:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241072640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875120.974999:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788875120.975007:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875120.975071:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241072640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.975079:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788875120.975128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241072640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875120.979954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.980993:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988736 00000100:00100000:2.0:1788875120.981006:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988736 00000100:00100000:0.0:1788875120.981029:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d04aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241072512:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875120.981063:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 54 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.981066:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875120.981114:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875120.981124:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:2347:x1875771217988736:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875120.981145:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875120.981153:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 54 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981166:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 54 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981194:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d829cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c94 expref: 54 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981223:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875120.981229:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981240:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981249:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875120.981280:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875120.981375:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:2347:x1875771217988736:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 251us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875120.981390:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00010000:00010000:0.0:1788875120.981589:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.981598:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875120.981673:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788875120.981679:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875120.981708:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.981760:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d829e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 53 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.981813:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 52 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875120.981821:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875120.981833:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875120.981836:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0400, rc 0) 00000100:00100000:0.0:1788875120.981987:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:10551:x1875771217988608:12345-192.168.202.7@tcp:101:bash.0 Request processed in 30457us (30853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875120.981995:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:1.0:1788875120.992614:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875120.992729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217988992 00000100:00100000:2.0:1788875120.992742:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217988992 00000100:00100000:2.0:1788875120.992849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1788875120.992862:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:10551:x1875771217988992:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:2.0:1788875120.993204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:10551:x1875771217988992:12345-192.168.202.7@tcp:35:bash.0 Request processed in 344us (602us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788875120.993213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:2.0:1788875121.099110:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.102073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217989120 00000100:00100000:3.0:1788875121.102093:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217989120 00000100:00100000:3.0:1788875121.102289:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:3.0:1788875121.102310:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:10558:x1875771217989120:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875121.102344:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875121.102374:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ca2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102459:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102477:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102493:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875121.102539:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788875121.102543:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875121.102565:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102596:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d829f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca2 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102654:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca2 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.102664:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875121.102667:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875121.102671:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00080000:0.0:1788875121.102983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875121.104089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217989120:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1777us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.104104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:3.0:1788875121.122213:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875121.122366:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217989248 00000100:00100000:0.0:1788875121.122381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217989248 00000100:00100000:0.0:1788875121.122516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:0.0:1788875121.122531:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217989248:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875121.122584:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875121.122612:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d829fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122715:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122735:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122766:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122833:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122847:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122854:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122968:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122976:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.122983:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875121.123026:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788875121.123037:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875121.123063:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123077:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123087:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123094:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123100:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123107:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875121.123111:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123120:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875121.123138:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875121.123145:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123152:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123170:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123187:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123198:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875121.123201:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123208:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123229:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875121.123232:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875121.123235:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123241:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d829fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca9 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123305:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca9 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.123313:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875121.123315:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875121.123323:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0c00, rc 0) 00000100:00100000:0.0:1788875121.123404:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10558:x1875771217989248:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 877us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.123412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1788875121.129101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875121.129222:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.129317:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217989632 00000100:00100000:3.0:1788875121.129331:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217989632 00000100:00100000:3.0:1788875121.129430:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:3.0:1788875121.129443:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10558:x1875771217989632:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875121.129470:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788875121.129472:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217989376 00000100:00100000:1.0:1788875121.129476:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217989376 00010000:00010000:3.0:1788875121.129498:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cb0 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875121.129516:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875121.129524:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:2348:x1875771217989376:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875121.129553:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875121.129579:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca9 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875121.129600:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:1.0:1788875121.129606:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875121.129645:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875121.129687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:2348:x1875771217989376:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 163us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875121.129694:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00010000:00010000:3.0:1788875121.129798:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 55 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.129810:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.129865:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 55 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.129881:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 55 pid: 11390 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875121.129898:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241072768:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875121.129980:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a01254780 going to sleep for 11 seconds 00000100:00100000:3.0:1788875121.133606:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012af800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241072768:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875121.133661:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875121.139569:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875121.145137:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217989760 00000100:00100000:0.0:1788875121.145157:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217989760 00010000:00010000:0.0:1788875121.145238:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 56 pid: 11390 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875121.147168:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:0.0:1788875121.147198:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05657c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:2347:x1875771217989760:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875121.147471:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875121.147487:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 56 pid: 11390 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147509:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 56 pid: 11390 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147541:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d829e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c9b expref: 56 pid: 11390 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147561:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875121.147568:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147580:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147589:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.147657:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875121.147862:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.147873:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875121.147899:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788875121.148110:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 57 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.148129:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 56 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.148136:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875121.148139:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875121.148150:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:0.0:1788875121.148929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05657c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:2347:x1875771217989760:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 1737us (9366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.148942:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:3.0:1788875121.149879:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10558:x1875771217989632:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 20428us (20645us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788875121.149890:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:1.0:1788875121.166034:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875121.173193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990016 00000100:00100000:0.0:1788875121.173222:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990016 00000100:00100000:0.0:1788875121.173344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1788875121.173358:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10558:x1875771217990016:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:0.0:1788875121.173382:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875121.173418:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c86 expref: 55 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.173442:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875121.173448:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875121.173529:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217990016:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 173us (7509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.173537:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788875121.181031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.182411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990144 00000100:00100000:3.0:1788875121.182431:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990144 00000100:00100000:3.0:1788875121.182528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:3.0:1788875121.182542:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217990144:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:3.0:1788875121.182730:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.182753:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.182799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875121.183070:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788875121.183195:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217990144:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 656us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.183204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:1.0:1788875121.192068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875121.192190:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990272 00000100:00100000:2.0:1788875121.192205:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990272 00000100:00100000:2.0:1788875121.192312:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 111 00000100:00100000:2.0:1788875121.192325:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:10558:x1875771217990272:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875121.192351:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875121.192378:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cb7 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192466:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192480:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 55 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192511:0:8216:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192526:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 55 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192543:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875121.192546:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875121.192551:0:8216:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 55 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875121.192560:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19000, rc 0) 00000100:00100000:2.0:1788875121.192649:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10558:x1875771217990272:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 327us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875121.192657:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 111 00010000:00010000:2.0:1788875121.425764:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875121.436904:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875121.436951:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875121.436992:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875121.437036:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875121.437347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990400 00000100:00100000:0.0:1788875121.437361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990400 00000100:00100000:0.0:1788875121.437447:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 290 00000100:00100000:0.0:1788875121.437459:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217990400:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875121.437557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771217990400:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 100us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.437566:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 290 00000100:00100000:3.0:1788875121.438246:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990656 00000100:00100000:3.0:1788875121.438254:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990656 00000100:00100000:3.0:1788875121.438323:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990528 00000100:00100000:3.0:1788875121.438336:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990528 00000100:00100000:3.0:1788875121.438379:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875121.438389:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771217990656:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875121.438668:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771217990656:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 280us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.438699:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875121.438720:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:3.0:1788875121.438727:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2350:x1875771217990528:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875121.438758:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2350:x1875771217990528:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.438764:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00080000:3.0:1788875121.438830:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875121.438847:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990784 00000100:00100000:3.0:1788875121.438853:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990784 00000100:00080000:3.0:1788875121.438873:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875121.438900:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00100000:3.0:1788875121.438907:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217990784:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875121.438940:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771217990784:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 33us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.438946:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00100000:1.0:1788875121.486306:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241073152:0@lo:400:kworker.0 00000100:00100000:1.0:1788875121.486428:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875121.486820:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241072896:0@lo:400:kworker.0 00000100:00100000:3.0:1788875121.486873:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875121.486918:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875121.486925:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241073024:0@lo:400:kworker.0 00000100:00100000:3.0:1788875121.486953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875121.487010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241073280:0@lo:400:kworker.0 00000100:00100000:3.0:1788875121.487043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875121.487085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073152 00000100:00100000:3.0:1788875121.487095:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073152 00000100:00100000:3.0:1788875121.487161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073024 00000100:00100000:3.0:1788875121.487183:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073024 00000100:00100000:3.0:1788875121.487214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788875121.487224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241073152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.488368:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788875121.488403:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241073024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.488501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241073024:12345-0@lo:400:kworker.0 Request processed in 107us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.488509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788875121.488580:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241073024:0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.488653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241072896 00000100:00100000:0.0:1788875121.488660:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241072896 00000100:00100000:0.0:1788875121.488698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788875121.488705:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241072896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.488747:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3303:x1875771241072896:12345-0@lo:400:kworker.0 Request processed in 43us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.488754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788875121.488832:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:372e367e-0deb-4060-9f2e-265b56425d5a:3303:1875771241072896:0@lo:400:kworker.0 00000100:00080000:0.0:1788875121.488869:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875121.488886:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073280 00000100:00100000:0.0:1788875121.488890:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073280 00000100:00100000:0.0:1788875121.488920:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788875121.488928:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241073280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.488972:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241073280:12345-0@lo:400:kworker.0 Request processed in 45us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.488978:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788875121.489051:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241073280:0@lo:400:kworker.0 00000100:00100000:2.0:1788875121.493708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241073536:0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.493950:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241073408:0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.494058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875121.494101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875121.494141:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073536 00000100:00100000:0.0:1788875121.494141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073408 00000100:00100000:2.0:1788875121.494151:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073536 00000100:00100000:0.0:1788875121.494163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073408 00000100:00080000:0.0:1788875121.494190:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875121.494238:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788875121.494248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241073408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875121.494314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875771241073408:12345-0@lo:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.494322:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788875121.494375:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241073408:0@lo:400:kworker.0 00000100:00100000:2.0:1788875121.494956:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788875121.494969:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241073536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875121.495027:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241073536:12345-0@lo:400:kworker.0 Request processed in 64us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875121.495034:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788875121.495074:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241073536:0@lo:400:kworker.0 00000100:00100000:3.0:1788875121.501598:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241073152:12345-0@lo:400:kworker.0 Request processed in 14179us (14974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.501628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788875121.501942:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241073152:0@lo:400:kworker.0 00000040:00080000:1.0:1788875121.934227:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788875121.934243:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788875121.934307:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788875121.934318:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788875121.935564:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d044a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241073664:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788875121.936848:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788875121.950005:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.950237:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217990912 00000100:00100000:3.0:1788875121.950248:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217990912 00000100:00100000:3.0:1788875121.950417:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:3.0:1788875121.950429:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217990912:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875121.950463:0:11390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788875121.951642:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d044a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241073664:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788875121.952942:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10559:x1875771217990912:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 2507us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.952956:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:3.0:1788875121.958449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875121.958650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217991040 00000100:00100000:0.0:1788875121.958661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217991040 00000100:00100000:0.0:1788875121.958738:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:0.0:1788875121.958750:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10559:x1875771217991040:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788875121.959466:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959488:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959502:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959555:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959563:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959570:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959627:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959637:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959645:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875121.959689:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788875121.959694:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875121.959708:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959720:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959726:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959734:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875121.959745:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959753:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959766:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:0.0:1788875121.959799:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875121.959806:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959813:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82a3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959829:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959835:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959842:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959847:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875121.959850:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959857:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875121.959868:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875121.959870:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959876:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82a44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959891:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959903:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959909:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959914:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875121.959918:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959925:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959939:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875121.959941:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875121.959945:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875121.959951:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875121.960662:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10559:x1875771217991040:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 1908us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.960673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 113 00000100:00100000:2.0:1788875121.978029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.978987:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217991296 00000100:00100000:3.0:1788875121.979005:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217991296 00000100:00100000:3.0:1788875121.979144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:3.0:1788875121.979158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:10559:x1875771217991296:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875121.979194:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875121.979227:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cbe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.979406:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.979426:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.979474:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875121.979491:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788875121.979994:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980005:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980012:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980019:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875121.980024:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980033:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980109:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875121.980113:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788875121.980119:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980127:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980190:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a52 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cbe expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980220:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:3.0:1788875121.980223:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875121.980227:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cbe expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875121.980239:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875121.980346:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217991296:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1191us (2335us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788875121.980356:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 114 00000100:00100000:1.0:1788875121.992366:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875121.992483:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217991424 00000100:00100000:3.0:1788875121.992509:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217991424 00000100:00100000:3.0:1788875121.992582:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 115 00000100:00100000:3.0:1788875121.992594:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217991424:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875121.992640:0:11390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788875121.992835:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217991424:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 243us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875121.992844:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 115 00000004:00080000:0.0:1788875121.998308:0:7927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336863532126ns, next at 337863519580ns, rc = 0 00000100:00100000:2.0:1788875121.998397:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875121.998428:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241073792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875121.998526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875121.998712:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241073792 00000100:00100000:0.0:1788875121.998725:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241073792 00000100:00100000:0.0:1788875121.998826:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788875121.998839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241073792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875121.999194:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875121.999620:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241073792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 772us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875121.999630:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788875121.999935:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241073792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875122.014741:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.023420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217991680 00000100:00100000:0.0:1788875122.023437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217991680 00000100:00100000:0.0:1788875122.023535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:0.0:1788875122.023547:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217991680:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875122.023577:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875122.023581:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788875122.023620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d829f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ca2 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.023642:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875122.023647:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875122.023674:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cc5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788875122.027443:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788875122.033437:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.033461:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.033475:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.033547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82a67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cc5 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.035414:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cc5 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.035426:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045baa00) 00010000:00010000:2.0:1788875122.035429:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875122.035432:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:2.0:1788875122.035520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:10559:x1875771217991680:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 11975us (21268us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788875122.035529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 116 00000100:00100000:1.0:1788875122.042358:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.042511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217991936 00000100:00100000:3.0:1788875122.042520:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217991936 00000100:00100000:3.0:1788875122.042631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:3.0:1788875122.042642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:10559:x1875771217991936:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788875122.042702:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875122.042726:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cc5 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042795:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045baa00) 00010000:00010000:3.0:1788875122.042807:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875122.042827:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042841:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042851:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042864:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042879:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042886:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042944:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042951:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042958:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042964:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875122.042968:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042980:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.042988:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875122.042990:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875122.042994:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043001:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82a7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043010:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043015:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043021:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043026:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875122.043029:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043034:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043040:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa0bfa1ef (ffff9e5a10903400) 00010000:00010000:3.0:1788875122.043042:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875122.043045:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.043057:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa0bfa1ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.043138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217991936:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 497us (791us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788875122.043144:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 117 00000100:00100000:1.0:1788875122.050308:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.050378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217992064 00000100:00100000:2.0:1788875122.050389:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217992064 00000100:00100000:2.0:1788875122.050451:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:2.0:1788875122.050461:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:10559:x1875771217992064:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.050482:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875122.050520:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ccc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050563:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050576:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050587:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050698:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050726:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.050735:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:2.0:1788875122.050738:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788875122.050742:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:2.0:1788875122.050835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:10559:x1875771217992064:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 375us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.050842:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 118 00000100:00100000:1.0:1788875122.056704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.056929:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217992320 00000100:00100000:2.0:1788875122.056939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217992320 00000100:00100000:2.0:1788875122.056984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 119 00000100:00100000:2.0:1788875122.056994:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:10559:x1875771217992320:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.057084:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.057103:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.057114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875122.057364:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788875122.057373:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336922600145ns, next at 337922598095ns, rc = 0 00000004:00010000:2.0:1788875122.057466:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5a29895 reply state 00000000db232952 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.057506:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875122.057606:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:10559:x1875771217992320:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 613us (911us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788875122.057623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 119 00010000:00010000:3.0:1788875122.062167:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062186:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062194:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062200:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875122.062205:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062213:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062230:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:3.0:1788875122.062232:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788875122.062237:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.062243:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82a98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.063005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.063074:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217992448 00000100:00100000:3.0:1788875122.063083:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217992448 00000100:00100000:3.0:1788875122.063138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:3.0:1788875122.063148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:10559:x1875771217992448:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875122.063170:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875122.063188:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cd3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.063243:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.063270:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.063290:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:3.0:1788875122.063292:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875122.063295:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:3.0:1788875122.063354:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:10559:x1875771217992448:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 208us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875122.063361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 120 00000100:00100000:1.0:1788875122.074043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.074240:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217992576 00000100:00100000:0.0:1788875122.074250:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217992576 00000100:00100000:0.0:1788875122.074416:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1788875122.074428:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217992576:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788875122.074830:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2347:x1875771217992576:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 403us (1336us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788875122.074838:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:1.0:1788875122.078157:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.078331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217992832 00000100:00100000:2.0:1788875122.078342:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217992832 00000100:00100000:2.0:1788875122.078405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:2.0:1788875122.078416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:10559:x1875771217992832:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788875122.079470:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:10559:x1875771217992832:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1052us (1321us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788875122.079481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1788875122.088431:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.088990:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993088 00000100:00100000:3.0:1788875122.089002:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993088 00000100:00100000:2.0:1788875122.089305:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:2.0:1788875122.089317:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:10559:x1875771217993088:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788875122.089443:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:10559:x1875771217993088:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 128us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.089450:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 121 00000100:00100000:1.0:1788875122.110933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.111202:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993216 00000100:00100000:0.0:1788875122.111227:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993216 00000100:00100000:0.0:1788875122.111360:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:0.0:1788875122.111371:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:10559:x1875771217993216:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875122.111392:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875122.111413:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cda expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.111499:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.111514:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.111526:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875122.111728:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875122.111752:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.112013:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cda expref: 62 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.112033:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cda expref: 61 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.112042:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:0.0:1788875122.112045:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788875122.112049:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0000, rc 0) 00000100:00100000:2.0:1788875122.112464:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:10559:x1875771217993216:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1094us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.112474:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 122 00000100:00100000:1.0:1788875122.123050:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.123214:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993344 00000100:00100000:2.0:1788875122.123225:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993344 00000100:00100000:2.0:1788875122.123330:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1788875122.123341:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c6e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771217993344:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.123359:0:6901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875122.123394:0:6901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ce1 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875122.123423:0:6901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa01172, blocks: 0x1 00010000:00010000:2.0:1788875122.123443:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788875122.123448:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875122.123458:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 10 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.123476:0:6901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 10 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.123490:0:6901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875122.123551:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c6e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2348:x1875771217993344:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 212us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.123568:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:1.0:1788875122.126686:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.126886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993600 00000100:00100000:2.0:1788875122.126895:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993600 00000100:00100000:2.0:1788875122.126999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:2.0:1788875122.127009:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:10559:x1875771217993600:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788875122.127127:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:10559:x1875771217993600:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 119us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.127137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:1.0:1788875122.131749:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.132217:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993728 00000100:00100000:3.0:1788875122.132228:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993728 00000100:00100000:2.0:1788875122.132510:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1788875122.132523:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:10559:x1875771217993728:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.132567:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875122.132587:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ce8 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.132628:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.132639:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875122.132643:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875122.132649:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.135438:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.135460:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.135478:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875771241073920:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875122.135591:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875122.154570:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875771241073920:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875122.154623:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.154649:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875122.154762:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:10559:x1875771217993728:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 22240us (23024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.155248:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:3.0:1788875122.156684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875122.157353:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993856 00000100:00100000:1.0:1788875122.157368:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993856 00010000:00010000:1.0:1788875122.157418:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.157759:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:1.0:1788875122.157813:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2348:x1875771217993856:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875122.157830:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875122.157856:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.157882:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.157930:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82ab4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce1 expref: 11 pid: 6901 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.157947:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788875122.157951:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875122.157960:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.157971:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.158010:0:8459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.158024:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d046d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241074048:192.168.202.7@tcp:105: 00000100:00100000:1.0:1788875122.158121:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875122.170623:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d046d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241074048:192.168.202.7@tcp:105: 00010000:00010000:3.0:1788875122.170830:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875122.171129:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2348:x1875771217993856:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 13299us (14396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875122.171141:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:2.0:1788875122.171635:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.171754:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217993984 00000100:00100000:0.0:1788875122.171806:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217993984 00002000:00100000:0.0:1788875122.171851:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e5a3fd49f80 x1875771217993984/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:28/0 lens 504/0 e 0 to 0 dl 1788875133 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788875122.171861:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3fd49f80 with x1875771217993984 ext(0->12) 00002000:00010000:0.0:1788875122.171877:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3fd49f80 00000100:00100000:0.0:1788875122.171903:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1788875122.171912:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2347:x1875771217993984:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788875122.175357:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:2347:x1875771217993984:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 3433us (3711us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788875122.175373:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00002000:00100000:0.0:1788875122.175389:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e5a3fd49f80 x1875771217993984/t4294967308(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:28/0 lens 504/448 e 0 to 0 dl 1788875133 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788875122.175400:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3fd49f80 with x1875771217993984 ext(0->12) 00002000:00010000:0.0:1788875122.175406:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3fd49f80 00000100:00100000:1.0:1788875122.183379:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.183988:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217994112 00000100:00100000:2.0:1788875122.184000:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217994112 00000100:00100000:2.0:1788875122.184152:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 124 00000100:00100000:2.0:1788875122.184164:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:10559:x1875771217994112:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788875122.285552:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:10559:x1875771217994112:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 101378us (102173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875122.285568:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 124 00000004:00080000:1.0:1788875122.285603:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1788875122.285638:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000020:00080000:1.0:1788875122.285649:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a24434b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788875122.285653:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a04874e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a24434c00 00000020:00080000:1.0:1788875122.285667:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a04874900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a35e35800 00000004:00080000:1.0:1788875122.285707:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1788875122.285734:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788875122.285741:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788875122.285804:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788875122.285813:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a012ed840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788875122.285816:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a362a2f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a012edc00 00000020:00080000:1.0:1788875122.285819:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a362a2600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a35a2f800 00000020:00080000:3.0:1788875122.286090:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788875122.286274:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788875122.286657:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875122.286676:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241074176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788875122.286745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875122.286975:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241074432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788875122.287002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875122.287022:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875122.287027:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241074304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788875122.287046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875122.287074:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241074176 00000100:00100000:1.0:1788875122.287080:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241074176 00000100:00100000:1.0:1788875122.287127:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241074432 00000100:00100000:1.0:1788875122.287131:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241074432 00000100:00100000:1.0:1788875122.287146:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241074304 00000100:00100000:1.0:1788875122.287148:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241074304 00000100:00100000:1.0:1788875122.287159:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788875122.287166:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241074176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788875122.287191:0:6901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788875122.287222:0:6901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa01170, atime: 0x6aa01171, ctime: 0x6aa01170, blocks: 0x1 00010000:00010000:1.0:1788875122.287229:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.287257:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1788875122.287262:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875122.287268:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.287284:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.287541:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.287550:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.287574:0:6901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875122.288404:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875122.288413:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.288423:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875122.288427:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.288441:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.288473:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.288482:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d38fd8/0x60858e6020d82ac2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.288501:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875122.288504:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875122.288505:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875122.288818:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241074176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1648us (2069us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788875122.288828:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788875122.288863:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788875122.288959:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241074432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788875122.289100:0:6901:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788875122.289104:0:6901:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788875122 00002000:00010000:1.0:1788875122.289106:0:6901:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788875122.289108:0:6901:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788875122 -> 1788875122 00002000:00010000:1.0:1788875122.289111:0:6901:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788875122.289153:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1875771241074432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (2149us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788875122.289160:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788875122.289174:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788875122.289182:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875771241074304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788875122.289195:0:6901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788875122.289211:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.289227:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.289235:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788875122.289238:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788875122.289243:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.289274:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875122.289427:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5905d71f80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788875122.289435:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241074432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788875122.290544:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 11 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.290566:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241074560:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875122.290670:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f780 going to sleep for 11 seconds 00000100:00080000:1.0:1788875122.290688:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788875122.290704:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875122.299557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000004:00080000:0.0:1788875122.301189:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a3d04a680/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788875122.301203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241074176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788875122.303456:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241074560:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875122.303488:0:6901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.304140:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217994240 00000100:00100000:3.0:1788875122.304149:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217994240 00010000:00010000:3.0:1788875122.304191:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 12 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.304285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:2.0:1788875122.305116:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.305845:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:2347:x1875771217994240:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875122.305938:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875122.305950:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 12 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.305969:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 12 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.305993:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094213797/0x60858e6020d82884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c47 expref: 12 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.306011:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875122.306031:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875122.306038:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.306049:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.306075:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875122.306132:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2347:x1875771217994240:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 297us (6587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875122.306140:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:1.0:1788875122.307480:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217994368 00000100:00100000:1.0:1788875122.307493:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217994368 00000100:00100000:1.0:1788875122.307550:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:1.0:1788875122.307559:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2347:x1875771217994368:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.307980:0:6901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.307995:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.308006:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.308015:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.308043:0:6901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875122.310732:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875122.310742:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.310756:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875122.310761:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.310795:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.310815:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.310823:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d82ac9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.310843:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875122.310845:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875122.310847:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875122.324880:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1875771241074304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35690us (37823us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788875122.324894:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788875122.325203:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5905d73100/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788875122.325212:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241074304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788875122.380316:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2347:x1875771217994368:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 72747us (75191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875122.380329:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000001:00080000:2.0:1788875122.380493:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788875122.380510:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788875122.384351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.384514:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217994624 00000100:00100000:3.0:1788875122.384526:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217994624 00000100:00100000:3.0:1788875122.384589:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:3.0:1788875122.384599:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10559:x1875771217994624:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788875122.384664:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875122.384692:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cda expref: 15 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.384714:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:3.0:1788875122.384719:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875122.384755:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.384813:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.384825:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875122.385090:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e27efc9 reply state 00000000961e929a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.385101:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788875122.385197:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:10559:x1875771217994624:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 598us (856us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788875122.385205:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:1.0:1788875122.395718:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.395808:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217994752 00000100:00100000:0.0:1788875122.395818:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217994752 00000100:00100000:0.0:1788875122.395880:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:0.0:1788875122.395890:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217994752:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788875122.396109:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788875122.396113:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788875122 -> 1788875121 00002000:00010000:0.0:1788875122.396115:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788875121 00002000:00010000:0.0:1788875122.396118:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788875122 -> 1788875121 00002000:00010000:0.0:1788875122.396120:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788875122.396187:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217994752:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 298us (479us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788875122.396195:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00010000:00010000:3.0:1788875122.399043:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399063:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399071:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399078:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875122.399084:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399092:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399110:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:3.0:1788875122.399113:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875122.399118:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.399124:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875122.399250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.399473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995008 00000100:00100000:2.0:1788875122.399486:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995008 00000100:00100000:2.0:1788875122.399583:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:2.0:1788875122.399593:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:10559:x1875771217995008:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.399682:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.399697:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.399706:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.399738:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.399752:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 15 pid: 5842 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.399766:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241074688:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875122.399882:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875122.403586:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875122.403976:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995136 00000100:00100000:0.0:1788875122.404002:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995136 00010000:00010000:0.0:1788875122.404045:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 16 pid: 5842 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875122.404082:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:0.0:1788875122.404092:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:2347:x1875771217995136:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875122.404107:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875122.404114:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 16 pid: 5842 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.404128:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 16 pid: 5842 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.404149:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:0.0:1788875122.404154:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.404162:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.404170:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.404188:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875122.404249:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:2347:x1875771217995136:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 158us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875122.404255:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00010000:00010000:2.0:1788875122.404587:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ccc expref: 15 pid: 5842 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.404616:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241074688:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875122.404638:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404647:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404679:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404708:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404716:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404723:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404729:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875122.404733:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404741:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404750:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:2.0:1788875122.404753:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788875122.404756:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.404762:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ad7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.404816:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10559:x1875771217995008:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 5224us (5570us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788875122.404824:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 126 00000100:00100000:1.0:1788875122.415534:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.415722:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995264 00000100:00100000:2.0:1788875122.415732:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995264 00000100:00100000:2.0:1788875122.415850:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:2.0:1788875122.415862:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771217995264:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788875122.415906:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.415927:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.415936:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875122.415941:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875122.415945:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.415982:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.415996:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 7 pid: 6697 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.416010:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241074816:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875122.416100:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875122.418123:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241074816:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875122.418153:0:6901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.420114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.420256:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995392 00000100:00100000:2.0:1788875122.420266:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995392 00010000:00010000:2.0:1788875122.420314:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 8 pid: 6697 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.420355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:2.0:1788875122.420365:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771217995392:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875122.420380:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875122.420412:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 8 pid: 6697 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.420425:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 8 pid: 6697 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.420445:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d10e64/0x60858e6020d82abb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ce8 expref: 8 pid: 6697 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.420460:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875122.420464:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875122.420469:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.420478:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.420535:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875122.420583:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771217995392:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 219us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.420590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00010000:00010000:3.0:1788875122.421226:0:6901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421238:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421265:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421274:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421282:0:6901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421301:0:6901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875122.421306:0:6901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421315:0:6901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421328:0:6901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.421351:0:6901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82ade lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875122.421529:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771217995264:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 5667us (6006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875122.421539:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:0.0:1788875122.425281:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875122.425487:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995648 00000100:00100000:1.0:1788875122.425545:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995648 00000100:00100000:1.0:1788875122.425647:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 127 00000100:00100000:1.0:1788875122.425889:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10559:x1875771217995648:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788875122.425974:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.425993:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426005:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426193:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426217:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426226:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426258:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.426272:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 15 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.426355:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241074944:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875122.426649:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788875122.430325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.430419:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995776 00000100:00100000:2.0:1788875122.430429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995776 00010000:00010000:2.0:1788875122.430465:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 16 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.430580:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:2.0:1788875122.430590:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:2348:x1875771217995776:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875122.430613:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875122.430621:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 16 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.430634:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 16 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.430654:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:2.0:1788875122.430670:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.430679:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.430687:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.430717:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875122.430802:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+16:2348:x1875771217995776:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 181us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.430810:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00010000:00010000:1.0:1788875122.430880:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cd3 expref: 15 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875122.430894:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241074944:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875122.430914:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.430922:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875122.430928:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788875122.431112:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788875122.431259:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788875122.431305:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788875122.431388:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8216:1875771241075072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788875122.431434:0:8216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875122.431462:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788875122.431487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241075072 00000100:00100000:1.0:1788875122.431504:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241075072 00000100:00100000:1.0:1788875122.431534:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875122.431540:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8216:x1875771241075072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788875122.431600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8216:x1875771241075072:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875122.431617:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875122.431648:0:8216:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788875122.431653:0:8216:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788875122.431667:0:8216:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5905d71f80, transno 4294967309 00000100:00100000:1.0:1788875122.431679:0:8216:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e5905d73100 x1875771241074304/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788875138 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875122.431690:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8216:1875771241075072:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788875122.432108:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788875122.432151:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8216:1875771241075200:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788875122.432178:0:8216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875122.432193:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788875122.432993:0:11970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241075200 00000100:00100000:0.0:1788875122.433000:0:11970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241075200 00000100:00100000:0.0:1788875122.433037:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788875122.433045:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8216:x1875771241075200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788875122.433209:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8216:x1875771241075200:12345-0@lo:1000:mdt00_003.0 Request processed in 165us (1029us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788875122.433216:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788875122.433358:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8216:1875771241075200:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788875122.433390:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433411:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433418:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433423:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875122.433428:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433434:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433448:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a045ba700) 00010000:00010000:0.0:1788875122.433451:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875122.433456:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433461:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82aec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433509:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433515:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433521:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433527:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875122.433530:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433536:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433544:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875122.433547:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875122.433554:0:8216:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 18 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433566:0:8216:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 18 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433574:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 18 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.433601:0:8216:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 18 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875122.433635:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d04b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241075328:192.168.202.7@tcp:105: 00000100:00100000:0.0:1788875122.434045:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10da5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788875122.438120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.438196:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217995904 00000100:00100000:3.0:1788875122.438212:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217995904 00000100:00100000:3.0:1788875122.438280:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:3.0:1788875122.438300:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10558:x1875771217995904:12345-192.168.202.7@tcp:49:lfs.0 00000100:00100000:3.0:1788875122.438468:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:10558:x1875771217995904:12345-192.168.202.7@tcp:49:lfs.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875122.438476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:2.0:1788875122.439210:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d04b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241075328:192.168.202.7@tcp:105: 00010000:00010000:2.0:1788875122.439241:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439252:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82a2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439292:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439308:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439319:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439329:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439335:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439341:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439346:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875122.439362:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439370:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439383:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875122.439385:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875122.439400:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439406:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82af3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439417:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439423:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439429:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439433:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875122.439435:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439440:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439447:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875122.439449:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788875122.439458:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.439464:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82ae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.439727:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10559:x1875771217995648:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 14070us (14456us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788875122.439736:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 127 00000020:00080000:2.0:1788875122.439740:0:8216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788875122.440062:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788875122.440067:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875122.440545:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788875122.440555:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788875122.444218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.444302:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217996160 00000100:00100000:2.0:1788875122.444311:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217996160 00000100:00100000:2.0:1788875122.444373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 128 00000100:00100000:2.0:1788875122.444383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10558:x1875771217996160:12345-192.168.202.7@tcp:58:lfs.0 00000040:00080000:2.0:1788875122.444809:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788875122.444900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10558:x1875771217996160:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 518us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.444909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 128 00010000:00010000:0.0:1788875122.446382:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875122.451240:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875122.451326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217996416 00000100:00100000:3.0:1788875122.451334:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217996416 00000100:00100000:3.0:1788875122.451402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:3.0:1788875122.451412:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:10559:x1875771217996416:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788875122.454040:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788875122.454202:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788875122.454272:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454294:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454306:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454315:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454322:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454328:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875122.454534:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788875122.454651:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:10559:x1875771217996416:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 3236us (3418us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788875122.454668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000020:00080000:3.0:1788875122.454674:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788875122.458999:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875122.459014:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.459026:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875122.459032:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.459042:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.459082:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e5a10903500) 00010000:00010000:2.0:1788875122.459085:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788875122.459091:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.459098:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82afa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.459121:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875122.459123:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875122.459125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875122.495130:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.495300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217996544 00000100:00100000:2.0:1788875122.495312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217996544 00000100:00100000:2.0:1788875122.495371:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 129 00000100:00100000:2.0:1788875122.495382:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:10561:x1875771217996544:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875122.495415:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875122.495438:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82b01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cef expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495504:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495519:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495530:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495545:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495566:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.495572:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.496816:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.496835:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 21 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.496844:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.496884:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 21 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.496899:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 21 pid: 11390 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875122.496912:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d048e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241075456:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875122.497048:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10da5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788875122.507995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.508156:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217996800 00000100:00100000:2.0:1788875122.508165:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217996800 00000100:00100000:2.0:1788875122.508223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:2.0:1788875122.508234:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:9963:x1875771217996800:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788875122.508425:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d048e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241075456:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875122.508450:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.508539:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:9963:x1875771217996800:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 307us (554us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788875122.508548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:1.0:1788875122.511144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875122.511255:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217996928 00000100:00100000:2.0:1788875122.511264:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217996928 00010000:00010000:2.0:1788875122.511309:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 23 pid: 11390 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875122.511351:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:2.0:1788875122.511360:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05657450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:2347:x1875771217996928:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875122.511378:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875122.511385:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 23 pid: 11390 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511465:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 23 pid: 11390 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511563:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82a21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb0 expref: 23 pid: 11390 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511581:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:2.0:1788875122.511586:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511595:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511613:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875122.511646:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875122.511969:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05657450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2347:x1875771217996928:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 608us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875122.511977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00010000:00010000:0.0:1788875122.511987:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512004:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875122.512045:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788875122.512050:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875122.512082:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512095:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512103:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512109:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512115:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512121:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875122.512125:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512133:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512141:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:0.0:1788875122.512144:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875122.512148:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512163:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512177:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512183:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512189:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512194:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875122.512198:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512203:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512211:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e5a045ba800) 00010000:00010000:0.0:1788875122.512213:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875122.512216:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512222:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cef expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512271:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cef expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875122.512285:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875122.512287:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875122.512290:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0e00, rc 0) 00000100:00100000:0.0:1788875122.512318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10561:x1875771217996544:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 16939us (17201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875122.512324:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 129 00000040:00080000:2.0:1788875123.303224:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875123.303236:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875123.303295:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788875123.303302:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788875123.470697:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788875123.471144:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875123.471149:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788875123.471219:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788875123.471226:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788875123.471518:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d048e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241075584:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788875123.471624:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788875123.476699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875123.477193:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d048e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241075584:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788875123.477689:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217997056 00000100:00100000:2.0:1788875123.477698:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217997056 00000100:00100000:2.0:1788875123.477888:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00100000:2.0:1788875123.477898:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10573:x1875771217997056:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788875123.477935:0:8216:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788875123.478040:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10573:x1875771217997056:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 144us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875123.478071:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 130 00000100:00080000:1.0:1788875123.480008:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875123.486490:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875123.486656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217997312 00000100:00100000:3.0:1788875123.486666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217997312 00000100:00100000:3.0:1788875123.486726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:3.0:1788875123.486736:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:10573:x1875771217997312:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875123.486755:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875123.486799:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cf6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.486909:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.486937:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.486950:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875123.486963:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788875123.487111:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cf6 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.487130:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cf6 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.487138:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875123.487141:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875123.487145:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875123.487211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10573:x1875771217997312:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 475us (729us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788875123.487218:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 131 00000100:00100000:0.0:1788875123.493608:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875123.493694:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217997568 00000100:00100000:3.0:1788875123.493705:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217997568 00000100:00100000:3.0:1788875123.493767:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1788875123.493813:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:2347:x1875771217997568:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875123.493827:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875123.493852:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cf6 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875123.493887:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875123.493892:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875123.493940:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2347:x1875771217997568:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 130us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875123.493947:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1788875123.501036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875123.501388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217997696 00000100:00100000:0.0:1788875123.501399:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217997696 00000100:00100000:0.0:1788875123.501462:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:0.0:1788875123.501473:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:10573:x1875771217997696:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788875123.501547:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.501570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.501609:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502032:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502041:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502047:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502054:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875123.502059:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502066:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502078:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875123.502080:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788875123.502085:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875123.502091:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82b32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875123.502295:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10573:x1875771217997696:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 822us (1267us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788875123.502303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 132 00000100:00100000:1.0:1788875123.506750:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875123.506940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217997952 00000100:00100000:2.0:1788875123.506953:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217997952 00000100:00100000:2.0:1788875123.507013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:2.0:1788875123.507023:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:10573:x1875771217997952:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788875123.507406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:10573:x1875771217997952:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 383us (666us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788875123.507414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000040:00080000:0.0:1788875123.509927:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875123.509937:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788875123.510626:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788875123.510636:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788875124.503216:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788875124.614145:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788875124.614191:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:2.0:1788875125.076179:0:12168:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875125.076187:0:12168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875125.076239:0:12168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788875125.076245:0:12168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788875125.234995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875125.237693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998208 00000100:00100000:0.0:1788875125.237707:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998208 00000100:00080000:1.0:1788875125.237798:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875125.237799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00100000:0.0:1788875125.237812:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:10593:x1875771217998208:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875125.237834:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875125.237854:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0cfd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.237952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.237967:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.237982:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875125.237994:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788875125.238129:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cfd expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.238147:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cfd expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.238155:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875125.238158:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788875125.238168:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0800, rc 0) 00000100:00100000:0.0:1788875125.238229:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:10593:x1875771217998208:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 419us (3241us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788875125.238236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 133 00000100:00100000:1.0:1788875125.245761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875125.245868:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998336 00000100:00100000:0.0:1788875125.245879:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998336 00000100:00100000:0.0:1788875125.245957:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 134 00000100:00100000:0.0:1788875125.245969:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:10593:x1875771217998336:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1788875125.246051:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246071:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246083:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246115:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246124:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246131:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246138:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875125.246143:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246152:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246182:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:0.0:1788875125.246185:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875125.246190:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.246198:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1000/0x60858e6020d82b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875125.246278:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:10593:x1875771217998336:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 312us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875125.246286:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 134 00000100:00100000:1.0:1788875125.360453:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875125.360621:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998464 00000100:00100000:0.0:1788875125.360632:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998464 00000100:00080000:1.0:1788875125.360690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875125.360717:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1788875125.360729:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771217998464:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1788875125.360747:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875125.360801:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705868b9/0x60858e6020d82b55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d04 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875125.360834:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa01171, atime: 0x6aa01171, ctime: 0x6aa01171, blocks: 0xb 00010000:00010000:0.0:1788875125.360854:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788875125.360859:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875125.360868:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705868b9/0x60858e6020d82b55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d04 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.360888:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000705868b9/0x60858e6020d82b55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d04 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875125.360922:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1000, rc 0) 00000100:00100000:0.0:1788875125.360986:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217998464:12345-192.168.202.7@tcp:101:cat.0 Request processed in 260us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875125.360994:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1788875125.364993:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875125.365089:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998592 00000100:00100000:3.0:1788875125.365099:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998592 00002000:00100000:3.0:1788875125.365151:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e5a3d049c00 x1875771217998592/t0(0) o3->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:31/0 lens 488/0 e 0 to 0 dl 1788875136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788875125.365161:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d049c00 with x1875771217998592 ext(0->4095) 00002000:00010000:3.0:1788875125.365167:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d049c00 00000100:00100000:3.0:1788875125.365198:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:3.0:1788875125.365206:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217998592:12345-192.168.202.7@tcp:3:cat.0 00000100:00100000:3.0:1788875125.365402:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771217998592:12345-192.168.202.7@tcp:3:cat.0 Request processed in 196us (421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788875125.365410:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00002000:00100000:3.0:1788875125.365416:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e5a3d049c00 x1875771217998592/t0(0) o3->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:31/0 lens 488/4536 e 0 to 0 dl 1788875136 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788875125.365425:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d049c00 with x1875771217998592 ext(0->4095) 00002000:00010000:3.0:1788875125.365428:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d049c00 00010000:00010000:0.0:1788875125.519090:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875126.102762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875126.102891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875126.103380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241075712 00000100:00100000:3.0:1788875126.103391:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241075712 00000100:00100000:3.0:1788875126.103488:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788875126.103501:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875126.103551:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875126.103628:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875126.103636:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788875126.103704:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241075712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788875126.103852:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788875126.542581:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875126.563055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875126.563109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875126.563166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875126.563279:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998976 00000100:00100000:2.0:1788875126.563292:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998976 00000100:00100000:2.0:1788875126.563382:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:2.0:1788875126.563395:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2349:x1875771217998976:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875126.563494:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2349:x1875771217998976:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 103us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.563501:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1788875126.564023:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998720 00000100:00100000:0.0:1788875126.564032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998720 00000100:00100000:0.0:1788875126.564082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 292 00000100:00100000:0.0:1788875126.564091:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217998720:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875126.564154:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2349:x1875771217998720:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 64us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875126.564161:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 292 00000100:00100000:3.0:1788875126.564451:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999232 00000100:00100000:3.0:1788875126.564457:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999232 00000100:00100000:3.0:1788875126.564519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00100000:3.0:1788875126.564527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217999232:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875126.564563:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2349:x1875771217999232:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 37us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875126.564580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00080000:0.0:1788875126.564726:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875126.568424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875126.568471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875126.568666:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999104 00000100:00100000:2.0:1788875126.568679:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999104 00000100:00100000:2.0:1788875126.568798:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:2.0:1788875126.568832:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217999104:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875126.568931:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771217999104:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.568940:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:0.0:1788875126.569157:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217998848 00000100:00100000:0.0:1788875126.569163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217998848 00000100:00100000:0.0:1788875126.569207:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 140 00000100:00100000:0.0:1788875126.569215:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:2350:x1875771217998848:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875126.569255:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:2350:x1875771217998848:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 41us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875126.569261:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 140 00000100:00080000:1.0:1788875126.571006:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875126.606541:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241075968:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.606647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875126.606719:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241076480:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.606750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875126.606807:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875126.606814:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.606840:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875126.606889:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241075968 00000100:00100000:2.0:1788875126.606899:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241075968 00000100:00100000:2.0:1788875126.606961:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076096 00000100:00100000:2.0:1788875126.606964:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076096 00000100:00100000:2.0:1788875126.607000:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788875126.607010:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241075968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.607070:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241075968:12345-0@lo:400:kworker.0 Request processed in 61us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.607078:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788875126.607101:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788875126.607107:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.607132:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241076096:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.607138:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788875126.607170:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076480 00000100:00100000:2.0:1788875126.607174:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076480 00000100:00100000:2.0:1788875126.607206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788875126.607214:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241076480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.607246:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241076480:12345-0@lo:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875126.607323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241075840:0@lo:400:kworker.0 00000100:00100000:1.0:1788875126.607366:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875126.607391:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241076352:0@lo:400:kworker.0 00000100:00100000:1.0:1788875126.607415:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875126.607437:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788875126.607443:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241076224:0@lo:400:kworker.0 00000100:00100000:1.0:1788875126.607469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875126.607819:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241075840 00000100:00100000:0.0:1788875126.607824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241075840 00000100:00100000:0.0:1788875126.607859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788875126.607868:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241075840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875126.607911:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241075840:12345-0@lo:400:kworker.0 Request processed in 45us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875126.607918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788875126.607973:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241075840:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.609433:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788875126.609497:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076224 00000100:00100000:2.0:1788875126.609510:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076224 00000100:00100000:2.0:1788875126.609563:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788875126.609585:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.609691:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241076224:12345-0@lo:400:kworker.0 Request processed in 108us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.609699:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788875126.609731:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076352 00000100:00100000:2.0:1788875126.609735:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076352 00000100:00100000:2.0:1788875126.609792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788875126.609799:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.609840:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241076352:12345-0@lo:400:kworker.0 Request processed in 43us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875126.609847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788875126.609893:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788875126.609899:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875126.609978:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.609993:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241075968:0@lo:400:kworker.0 00000100:00100000:2.0:1788875126.610005:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788875126.610011:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788875126.610049:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a3d04a680, transno 4294967304 00000100:00100000:2.0:1788875126.610060:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241076480:0@lo:400:kworker.0 00000100:00100000:0.0:1788875126.610650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241076224:0@lo:400:kworker.0 00000100:00100000:0.0:1788875126.610668:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788875127.119034:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875127.119066:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875127.119338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875127.119432:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076608 00000100:00100000:3.0:1788875127.119442:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076608 00000100:00100000:3.0:1788875127.119513:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788875127.119523:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241076608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875127.119580:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875127.119635:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241076608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875127.119643:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788875127.119702:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241076608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875127.566154:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788875127.641139:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875127.641153:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788875127.641194:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788875127.641202:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788875127.734758:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788875127.734801:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788875127.741263:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788875127.741292:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a3d38f600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788875127.741298:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a35c73200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a3d38f000 00000020:00080000:1.0:1788875127.741302:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a35c73800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a361ae400 00000020:00080000:1.0:1788875127.741347:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788875127.741389:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788875127.741652:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788875128.598197:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875129.616109:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875130.607575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875130.607768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999360 00000100:00100000:3.0:1788875130.607818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999360 00000100:00100000:3.0:1788875130.607918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00100000:3.0:1788875130.607932:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10238:x1875771217999360:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788875130.608083:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10238:x1875771217999360:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 Request processed in 154us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875130.608091:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 135 00000100:00080000:1.0:1788875130.609007:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875130.626333:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875130.626609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999616 00000100:00100000:1.0:1788875130.626623:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999616 00000100:00100000:1.0:1788875130.626704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:1.0:1788875130.626716:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:10238:x1875771217999616:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788875130.627579:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:10238:x1875771217999616:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 859us (1256us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788875130.627589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00010000:00010000:2.0:1788875130.643253:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875131.041420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875131.042642:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999744 00000100:00100000:2.0:1788875131.042660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999744 00000100:00100000:2.0:1788875131.042800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 136 00000100:00100000:2.0:1788875131.042815:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:11047:x1875771217999744:12345-192.168.202.7@tcp:101:lsof.0 00010000:00010000:2.0:1788875131.042843:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875131.042873:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d0b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.042971:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.042989:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.043004:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875131.043063:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788875131.043068:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875131.043116:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.043164:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.043197:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875131.043206:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:2.0:1788875131.043209:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875131.043214:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:2.0:1788875131.043299:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:11047:x1875771217999744:12345-192.168.202.7@tcp:101:lsof.0 Request processed in 489us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.043307:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 136 00000100:00080000:3.0:1788875131.045396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875131.214182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241076736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875131.214293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875131.214580:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076736 00000100:00100000:3.0:1788875131.214592:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076736 00000100:00100000:3.0:1788875131.214680:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788875131.214692:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241076736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875131.214742:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875131.214836:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241076736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875131.214845:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788875131.214955:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875131.215160:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788875131.215170:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5905d73100, transno 4294967310 00000004:00080000:2.0:1788875131.215196:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788875131.215237:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241076736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788875131.662859:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875131.679273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875131.679332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875131.679370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875131.679407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875131.679448:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000256 00000100:00100000:2.0:1788875131.679461:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000256 00000100:00100000:2.0:1788875131.679575:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000128 00000100:00100000:2.0:1788875131.679578:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000128 00000100:00100000:2.0:1788875131.679612:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:2.0:1788875131.679623:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771218000256:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875131.679744:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771218000256:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.679753:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:2.0:1788875131.679817:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:2.0:1788875131.679825:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218000128:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875131.679852:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218000128:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.679858:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00080000:2.0:1788875131.679886:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788875131.679890:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875131.680477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771217999872 00000100:00100000:1.0:1788875131.680486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771217999872 00000100:00100000:1.0:1788875131.680550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 294 00000100:00100000:1.0:1788875131.680559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217999872:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875131.680614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2347:x1875771217999872:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 57us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875131.680622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 294 00000100:00100000:0.0:1788875131.681126:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000000 00000100:00100000:0.0:1788875131.681134:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000000 00000100:00100000:0.0:1788875131.681187:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:0.0:1788875131.681196:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2347:x1875771218000000:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875131.681266:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2347:x1875771218000000:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 71us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875131.681275:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:2.0:1788875131.726285:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875131.726491:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788875131.726497:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726533:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875131.726567:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077120 00000100:00100000:2.0:1788875131.726577:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077120 00000100:00100000:2.0:1788875131.726652:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076992 00000100:00100000:2.0:1788875131.726655:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076992 00000100:00100000:2.0:1788875131.726677:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788875131.726686:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726745:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241077120:12345-0@lo:400:kworker.0 Request processed in 60us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.726753:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788875131.726800:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788875131.726807:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241076992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726854:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241076992:12345-0@lo:400:kworker.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.726861:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788875131.726884:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875131.726924:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726934:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726962:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241077248:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.726985:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875131.727009:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788875131.727014:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241076864:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875131.727067:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241077376:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875131.727122:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241076864 00000100:00100000:2.0:1788875131.727125:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241076864 00000100:00100000:2.0:1788875131.727152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788875131.727159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241076864:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.727199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788875131.727227:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077376 00000100:00100000:2.0:1788875131.727229:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077376 00000100:00100000:2.0:1788875131.727257:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788875131.727262:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241077376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727291:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241077376:12345-0@lo:400:kworker.0 Request processed in 28us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.727304:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788875131.727320:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875131.727333:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241076864:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727343:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241077376:0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727360:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077248 00000100:00100000:2.0:1788875131.727362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077248 00000100:00100000:2.0:1788875131.727385:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788875131.727391:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875131.727420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241077248:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875131.727426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788875131.727435:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875131.727449:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241077248:0@lo:400:kworker.0 00000100:00100000:3.0:1788875132.238174:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875132.238296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875132.238544:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077504 00000100:00100000:1.0:1788875132.238566:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077504 00000100:00100000:1.0:1788875132.238651:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788875132.238663:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241077504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875132.238713:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875132.238813:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241077504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875132.238821:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788875132.239050:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241077504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875132.687420:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788875132.910896:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788875132.910917:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788875132.911723:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788875132.911741:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788875133.710300:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875134.737863:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875135.757960:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875135.885767:0:12371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:45:34 (1788875134) 00000100:00100000:2.0:1788875136.334619:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875136.334653:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241077632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875136.334766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875136.335099:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077632 00000100:00100000:1.0:1788875136.335111:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077632 00000100:00100000:1.0:1788875136.335219:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788875136.335233:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241077632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788875136.335284:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875136.335375:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241077632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875136.335389:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788875136.336692:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875136.336799:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241077632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788875136.782122:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875136.798934:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875136.798992:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875136.799024:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875136.799053:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875136.799077:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875136.799112:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000896 00000100:00100000:2.0:1788875136.799124:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000896 00000100:00100000:3.0:1788875136.799287:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000640 00000100:00100000:3.0:1788875136.799301:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000640 00000100:00100000:3.0:1788875136.799354:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000768 00000100:00100000:3.0:1788875136.799357:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000768 00000100:00100000:3.0:1788875136.799381:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:3.0:1788875136.799392:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771218000640:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875136.799511:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771218000640:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 120us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875136.799519:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:3.0:1788875136.799539:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:3.0:1788875136.799545:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218000768:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875136.799570:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218000768:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875136.799577:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00080000:3.0:1788875136.800003:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875136.800009:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788875136.800013:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875136.800165:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000512 00000100:00100000:1.0:1788875136.800173:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000512 00000100:00100000:1.0:1788875136.800244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:1.0:1788875136.800254:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2348:x1875771218000512:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875136.800316:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2348:x1875771218000512:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 65us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875136.800323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:2.0:1788875136.800664:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00100000:2.0:1788875136.800674:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218000896:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875136.800718:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218000896:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 46us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875136.800725:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00080000:3.0:1788875136.800942:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875136.801423:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218000384 00000100:00100000:0.0:1788875136.801435:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218000384 00000100:00100000:0.0:1788875136.801496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 296 00000100:00100000:0.0:1788875136.801506:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218000384:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875136.801564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218000384:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 60us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875136.801572:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 296 00000100:00100000:1.0:1788875136.852454:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241077888:0@lo:400:kworker.0 00000100:00100000:2.0:1788875136.852507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241077760:0@lo:400:kworker.0 00000100:00100000:0.0:1788875136.852587:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241078144:0@lo:400:kworker.0 00000100:00100000:2.0:1788875136.852692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875136.852692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875136.852797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077888 00000100:00100000:1.0:1788875136.852807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241077760 00000100:00100000:3.0:1788875136.852809:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077888 00000100:00100000:1.0:1788875136.852810:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241077760 00000100:00100000:3.0:1788875136.852869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788875136.852869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788875136.852879:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241077760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875136.852880:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241077888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875136.852939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241077760:12345-0@lo:400:kworker.0 Request processed in 61us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875136.852942:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875771241077888:12345-0@lo:400:kworker.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875136.852950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788875136.852957:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788875136.853012:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241078016:0@lo:400:kworker.0 00000100:00100000:1.0:1788875136.853020:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875771241077888:0@lo:400:kworker.0 00000100:00100000:3.0:1788875136.853039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875136.853074:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241078016 00000100:00100000:1.0:1788875136.853078:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241078016 00000100:00100000:1.0:1788875136.853124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788875136.853162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241078016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875136.853202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241078016:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875136.853209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788875136.853239:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241078016:0@lo:400:kworker.0 00000100:00080000:3.0:1788875136.853415:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875136.853514:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875136.853641:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241077760:0@lo:400:kworker.0 00000100:00100000:2.0:1788875136.853651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241078272:0@lo:400:kworker.0 00000100:00100000:2.0:1788875136.853683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875136.853796:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241078144 00000100:00100000:1.0:1788875136.853802:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241078144 00000100:00100000:1.0:1788875136.853841:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788875136.853848:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875136.853906:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241078144:12345-0@lo:400:kworker.0 Request processed in 58us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875136.853914:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788875136.854054:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241078144:0@lo:400:kworker.0 00000100:00080000:0.0:1788875136.856313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875136.857311:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241078272 00000100:00100000:3.0:1788875136.857328:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241078272 00000100:00100000:3.0:1788875136.857436:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788875136.857448:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241078272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875136.857637:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241078272:12345-0@lo:400:kworker.0 Request processed in 192us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875136.857645:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788875136.857739:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875136.857796:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788875137.330149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875137.330266:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001152 00000100:00100000:3.0:1788875137.330280:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001152 00000100:00100000:3.0:1788875137.330370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00100000:3.0:1788875137.330383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:11313:x1875771218001152:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875137.330412:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875137.330441:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d12 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330549:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330569:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330586:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330604:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330612:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.330619:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331275:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82b7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331297:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82b7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331305:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82b7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875137.331319:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788875137.331530:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331539:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331547:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331553:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875137.331559:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331568:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331583:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a10bf8f00) 00010000:00010000:3.0:1788875137.331586:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875137.331591:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331599:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82b71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331612:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331625:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331632:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331637:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875137.331640:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331647:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e5a10903400) 00010000:00010000:3.0:1788875137.331656:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875137.331658:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.331664:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82b78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.334885:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82b6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d12 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.334926:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82b7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d12 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875137.334938:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:3.0:1788875137.334941:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875137.334959:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788875137.335225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:11313:x1875771218001152:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 4843us (5089us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788875137.335236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 137 00000100:00100000:3.0:1788875137.346135:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875137.346403:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875137.347087:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001408 00000100:00100000:0.0:1788875137.347103:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001408 00000100:00100000:0.0:1788875137.347201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1788875137.347214:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:2350:x1875771218001408:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875137.347240:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875137.347288:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82b7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d12 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875137.347317:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:0.0:1788875137.347324:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875137.347408:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2350:x1875771218001408:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 196us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875137.347417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875137.350996:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001280 00000100:00100000:2.0:1788875137.351016:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001280 00000100:00100000:2.0:1788875137.352216:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:2.0:1788875137.352240:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:11313:x1875771218001280:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788875137.352561:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:11313:x1875771218001280:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 330us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875137.352571:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 138 00000100:00100000:1.0:1788875137.358480:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241078400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875137.358592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875137.359349:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241078400 00000100:00100000:3.0:1788875137.359363:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241078400 00000100:00100000:3.0:1788875137.359446:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788875137.359458:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241078400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875137.359517:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875137.365453:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241078400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5979us (6842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875137.365484:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788875137.368680:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241078400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875137.806385:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788875137.871923:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875137.871939:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875137.876427:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788875137.876446:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788875137.954889:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788875138.830557:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875139.681660:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875139.684011:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001536 00000100:00100000:1.0:1788875139.684456:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001536 00000100:00100000:1.0:1788875139.684616:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00100000:1.0:1788875139.684630:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:11356:x1875771218001536:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875139.684658:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875139.684688:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d19 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684814:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684831:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684861:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684890:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684898:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.684905:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685248:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685257:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685265:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685273:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875139.685279:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685299:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685314:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875139.685317:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875139.685324:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685331:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685345:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685352:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685358:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685364:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875139.685367:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685373:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685380:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875139.685383:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875139.685385:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685401:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82b9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685459:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82b8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d19 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875139.685473:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875139.685477:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d19 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.685487:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35800, rc 0) 00000100:00100000:1.0:1788875139.685588:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:11356:x1875771218001536:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 961us (3943us total) trans 0 rc 301/301 00000100:00100000:1.0:1788875139.685597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 139 00000100:00080000:3.0:1788875139.690274:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875139.693620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875139.693980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001792 00000100:00100000:3.0:1788875139.693992:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001792 00000100:00100000:3.0:1788875139.694247:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 140 00000100:00100000:3.0:1788875139.694261:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:11356:x1875771218001792:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:3.0:1788875139.694341:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875139.694373:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8250b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b52 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.694391:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875139.694395:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875139.694681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.694703:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.694714:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.694755:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.694811:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 5 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875139.694830:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241078528:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875139.694967:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875139.698512:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241078528:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875139.698553:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875139.708475:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875139.709281:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218001920 00000100:00100000:2.0:1788875139.709296:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218001920 00010000:00010000:2.0:1788875139.709372:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 6 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875139.709416:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:2.0:1788875139.709426:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2347:x1875771218001920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875139.709453:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875139.709461:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 6 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709477:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 6 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709504:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82b63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d0b expref: 6 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709521:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:2.0:1788875139.709527:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709538:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709557:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.709589:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788875139.709742:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875139.709999:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2347:x1875771218001920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 573us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875139.710008:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00010000:00010000:2.0:1788875139.710061:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.710071:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.710102:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.710114:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.710122:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875139.714615:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788875139.714643:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714658:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714668:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714686:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875139.714693:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714702:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714723:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:2.0:1788875139.714727:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875139.714732:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.714739:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ba2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875139.714762:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f54d5c1 reply state 00000000131b1cfc transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875139.714794:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875139.714947:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:11356:x1875771218001792:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 20684us (21336us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788875139.714958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 140 00010000:00010000:3.0:1788875139.722744:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.722802:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.722813:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.722821:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875139.723095:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.723107:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.723140:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5a045baf00) 00010000:00010000:3.0:1788875139.723143:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875139.723150:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.723157:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ba9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875139.821858:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875139.821927:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002048 00000100:00100000:0.0:1788875139.821941:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002048 00000100:00100000:0.0:1788875139.822015:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 141 00000100:00100000:0.0:1788875139.822029:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:11364:x1875771218002048:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:0.0:1788875139.822065:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875139.822097:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82bb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d20 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822203:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822221:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822245:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875139.822297:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875139.822302:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875139.822332:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822361:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82bb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d20 expref: 15 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822385:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d20 expref: 14 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.822412:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:0.0:1788875139.822416:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875139.822421:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1800, rc 0) 00000100:00100000:0.0:1788875139.822519:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:11364:x1875771218002048:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 493us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875139.822527:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 141 00010000:00010000:2.0:1788875139.854379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875139.914835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875139.914892:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002176 00000100:00100000:1.0:1788875139.914906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002176 00000100:00100000:1.0:1788875139.914983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 142 00000100:00100000:1.0:1788875139.914995:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:11370:x1875771218002176:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875139.915021:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875139.915047:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d27 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915132:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915149:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915184:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915205:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915213:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915468:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915486:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875139.915520:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788875139.915524:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875139.915545:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915560:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915567:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915584:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915591:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875139.915597:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915606:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915622:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:1.0:1788875139.915625:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875139.915630:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915666:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915674:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915680:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915685:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875139.915688:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915813:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875139.915825:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875139.915829:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915835:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82bcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915879:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d27 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915893:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d27 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875139.915900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875139.915903:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788875139.915906:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35000, rc 0) 00000100:00100000:1.0:1788875139.915982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:11370:x1875771218002176:12345-192.168.202.7@tcp:101:bash.0 Request processed in 989us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875139.915990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 142 00000100:00100000:3.0:1788875139.920607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875139.920647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002432 00000100:00100000:2.0:1788875139.920661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002432 00000100:00100000:2.0:1788875139.920826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 143 00000100:00100000:2.0:1788875139.920838:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+15:11370:x1875771218002432:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1788875139.920889:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875139.920915:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82bda lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d2e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.921089:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.921107:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.921121:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.923281:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.923311:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.923326:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788875139.925872:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788875139.926138:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.926161:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.926176:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928240:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928252:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928260:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875139.928271:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928305:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928326:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875139.928329:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875139.928335:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82be1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875139.928365:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089454d97 reply state 0000000018520a77 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875139.928375:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788875139.928430:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82bda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928456:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.928464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875139.928466:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875139.928469:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:0.0:1788875139.928566:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11370:x1875771218002432:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7730us (7969us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788875139.928576:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 143 00010000:00010000:2.0:1788875139.933743:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933768:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933808:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933815:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875139.933821:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933855:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933877:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875139.933880:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875139.933887:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875139.933894:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82be8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875139.938380:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875139.938487:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002560 00000100:00100000:0.0:1788875139.938504:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002560 00000100:00100000:0.0:1788875139.938628:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00080000:2.0:1788875139.938662:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875139.938697:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771218002560:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875139.938724:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875139.938753:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d35 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875139.938817:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875139.938845:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788875139.938850:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875139.938862:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.938885:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.938901:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1400, rc 0) 00000100:00100000:0.0:1788875139.938977:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218002560:12345-192.168.202.7@tcp:101:bash.0 Request processed in 339us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875139.942487:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:1.0:1788875139.942585:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875139.942816:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002688 00000100:00100000:3.0:1788875139.942832:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002688 00000100:00100000:3.0:1788875139.942925:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875139.942935:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:11370:x1875771218002688:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875139.942956:0:6901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875139.942977:0:6901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d3c expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.943011:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.943018:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875139.943022:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875139.943043:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 7 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.943083:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.943096:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875139.943110:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6901:1875771241078656:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875139.943245:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04f91600 going to sleep for 11 seconds 00000100:00100000:3.0:1788875139.950854:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6901:1875771241078656:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875139.950911:0:6901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 7 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875139.950940:0:6901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15c00, rc 0) 00000100:00100000:2.0:1788875139.950957:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875139.951049:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218002816 00000100:00100000:0.0:1788875139.951059:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218002816 00000100:00100000:3.0:1788875139.951087:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:11370:x1875771218002688:12345-192.168.202.7@tcp:101:bash.0 Request processed in 8151us (8522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875139.951101:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00010000:00010000:0.0:1788875139.951115:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 8 pid: 6697 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875139.951160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:0.0:1788875139.951171:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218002816:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875139.951221:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875139.951251:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.951265:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.951296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0aa749f/0x60858e6020d82bfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d35 expref: 7 pid: 6697 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.951314:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875139.951319:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875139.951329:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.951342:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875139.951383:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875139.951400:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241078784:192.168.202.7@tcp:105: 00000100:00100000:0.0:1788875139.955561:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875139.964659:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875139.964855:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241078784:192.168.202.7@tcp:105: 00010000:00010000:0.0:1788875139.964889:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875139.964980:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771218002816:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 13810us (14022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875139.964993:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:1.0:1788875139.967552:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218003072 00000100:00100000:1.0:1788875139.967573:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218003072 00000100:00100000:0.0:1788875139.969497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:0.0:1788875139.969514:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:11370:x1875771218003072:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1788875139.970032:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11370:x1875771218003072:12345-192.168.202.7@tcp:35:bash.0 Request processed in 521us (5386us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788875139.970042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1788875140.046306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.046419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218003328 00000100:00100000:0.0:1788875140.046434:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218003328 00000100:00100000:0.0:1788875140.046560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:0.0:1788875140.046574:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11380:x1875771218003328:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875140.046606:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875140.046634:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d43 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875140.046879:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788875140.047042:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d43 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.047060:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:0.0:1788875140.047063:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875140.047070:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d43 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.047088:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1400, rc 0) 00000100:00100000:0.0:1788875140.047171:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11380:x1875771218003328:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 599us (878us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788875140.047197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 144 00000100:00100000:1.0:1788875140.052275:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.052460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218003584 00000100:00100000:3.0:1788875140.052474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218003584 00000100:00100000:3.0:1788875140.052555:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1788875140.052566:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11380:x1875771218003584:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875140.053078:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11380:x1875771218003584:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 511us (817us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788875140.053108:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:3.0:1788875140.132698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875140.133100:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218003712 00000100:00100000:1.0:1788875140.133135:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218003712 00000100:00100000:1.0:1788875140.133225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 145 00000100:00100000:1.0:1788875140.133238:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11386:x1875771218003712:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875140.133272:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875140.133302:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d4a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133391:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133408:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133422:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875140.133476:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788875140.133480:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875140.133501:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133533:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35400/0x60858e6020d82c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d4a expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133557:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d4a expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.133566:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875140.133570:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875140.133574:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35200, rc 0) 00000100:00100000:1.0:1788875140.133667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11386:x1875771218003712:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 433us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875140.133675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 145 00000100:00100000:2.0:1788875140.137041:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.137157:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218003968 00000100:00100000:0.0:1788875140.137170:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218003968 00000100:00100000:0.0:1788875140.137262:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:0.0:1788875140.137274:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11386:x1875771218003968:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875140.137311:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875140.137339:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d51 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.137480:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.137500:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.137518:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875140.137532:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788875140.137731:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d51 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.138097:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d51 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.138107:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875140.138110:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875140.138114:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1c00, rc 0) 00000100:00100000:0.0:1788875140.138535:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:11386:x1875771218003968:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1260us (1504us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788875140.138546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 146 00000100:00100000:2.0:1788875140.141589:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875140.141638:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.141718:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004096 00000100:00100000:3.0:1788875140.141731:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004096 00000100:00100000:3.0:1788875140.141838:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:3.0:1788875140.141851:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:2348:x1875771218004096:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875140.141871:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875140.141903:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82c2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d51 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.141927:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:3.0:1788875140.141933:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875140.141995:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2348:x1875771218004096:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 147us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.142003:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:0.0:1788875140.143110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004352 00000100:00100000:0.0:1788875140.143309:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004352 00000100:00100000:0.0:1788875140.143420:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:0.0:1788875140.143431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11386:x1875771218004352:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875140.143474:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875140.143504:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.143646:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.143666:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.143680:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875140.143695:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788875140.143913:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d58 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.143936:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d58 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.143947:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875140.143950:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788875140.143975:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1200, rc 0) 00000100:00100000:0.0:1788875140.144057:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11386:x1875771218004352:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 628us (2416us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788875140.144066:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 147 00000100:00100000:3.0:1788875140.150026:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875140.150269:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004480 00000100:00100000:2.0:1788875140.150283:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004480 00000100:00100000:2.0:1788875140.150392:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1788875140.150405:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218004480:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:2.0:1788875140.150480:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.150510:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.150544:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788875140.150550:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875140.150557:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.150602:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.150618:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 6 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875140.150635:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241078912:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875140.150758:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788875140.153744:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241078912:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875140.153815:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875140.154631:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.154827:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004608 00000100:00100000:0.0:1788875140.154839:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004608 00002000:00100000:0.0:1788875140.154911:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e5a3d3d8700 x1875771218004608/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:46/0 lens 504/0 e 0 to 0 dl 1788875151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788875140.154922:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d3d8700 with x1875771218004608 ext(0->12) 00010000:00010000:0.0:1788875140.154932:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 7 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.154949:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 7 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875140.154957:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d3d8700 00000100:00100000:0.0:1788875140.155114:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1788875140.155136:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771218004608:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:0.0:1788875140.155858:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2347:x1875771218004608:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 720us (1227us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788875140.155868:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00002000:00100000:0.0:1788875140.155878:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e5a3d3d8700 x1875771218004608/t4294967305(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:46/0 lens 504/448 e 0 to 0 dl 1788875151 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788875140.155888:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d3d8700 with x1875771218004608 ext(0->12) 00010000:00010000:0.0:1788875140.155896:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.155923:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875140.155931:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3d3d8700 00000100:00100000:2.0:1788875140.161039:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.161126:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004736 00000100:00100000:3.0:1788875140.161150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004736 00010000:00010000:3.0:1788875140.161206:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875140.161280:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:3.0:1788875140.161291:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2349:x1875771218004736:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875140.161312:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788875140.161338:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788875140.161341:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788875140 00002000:00010000:3.0:1788875140.161343:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788875140 00002000:00010000:3.0:1788875140.161344:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788875140 00010000:00010000:3.0:1788875140.161349:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.161361:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.161388:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c51835/0x60858e6020d82c04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d3c expref: 9 pid: 6901 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.161406:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875140.161409:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875140.161415:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.161424:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.161470:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875140.161539:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2349:x1875771218004736:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 250us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.161545:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00010000:00010000:2.0:1788875140.161824:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161836:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161866:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161873:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161890:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161895:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875140.161899:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161906:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161919:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.161925:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d0e1ba5/0x60858e6020d82c51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875140.161976:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771218004480:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 11575us (11965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875140.161981:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:1.0:1788875140.166368:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.166494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218004992 00000100:00100000:0.0:1788875140.166507:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218004992 00000100:00100000:0.0:1788875140.166576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:0.0:1788875140.166589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11386:x1875771218004992:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:0.0:1788875140.166745:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d58 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875140.167155:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788875140.167500:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788875140.168565:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788875140.168649:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.168674:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.168684:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.169201:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.169274:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 28 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875140.169306:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875771241079040:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875140.169500:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258000 going to sleep for 11 seconds 00000100:00100000:1.0:1788875140.172677:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.173281:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218005120 00000100:00100000:3.0:1788875140.173291:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218005120 00010000:00010000:3.0:1788875140.173357:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 29 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875140.173411:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875140.173422:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05656450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:2347:x1875771218005120:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875140.173454:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875140.173462:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 29 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173478:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 29 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173504:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d2e expref: 29 pid: 5843 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173524:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:3.0:1788875140.173530:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173542:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173551:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.173597:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875140.173669:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05656450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:2347:x1875771218005120:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 249us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.173677:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1788875140.173876:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875771241079040:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875140.173905:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.173917:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.173923:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875140.174088:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788875140.174647:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788875140.175651:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241079168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788875140.176090:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875140.176197:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875140.176263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241079168 00000100:00100000:1.0:1788875140.176275:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241079168 00000100:00080000:2.0:1788875140.176339:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875140.176360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788875140.176371:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241079168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788875140.176489:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241079168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875140.176497:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788875140.176858:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241079168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788875140.179599:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788875140.179728:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241079296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788875140.179853:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875140.179905:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258000 going to sleep for 11 seconds 00000100:00100000:3.0:1788875140.179917:0:11970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241079296 00000100:00100000:3.0:1788875140.179928:0:11970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241079296 00000100:00100000:3.0:1788875140.180000:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788875140.180011:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241079296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788875140.181049:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5844:x1875771241079296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1034us (1191us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788875140.181062:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788875140.181245:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241079296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788875140.181354:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788875140.181410:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181430:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181444:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875140.181450:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181460:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181499:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:1.0:1788875140.181503:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788875140.181513:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.181523:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82c58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875140.181754:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788875140.181940:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788875140.181955:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355047178943ns, next at 356047176958ns, rc = 0 00000001:00080000:1.0:1788875140.181961:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788875140.181992:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:1.0:1788875140.181998:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788875140.182006:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82c43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d58 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875140.182151:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:11386:x1875771218004992:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 15564us (15797us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788875140.182161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00000020:00080000:1.0:1788875140.182166:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788875140.187641:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.187740:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218005248 00000100:00100000:3.0:1788875140.187754:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218005248 00000100:00100000:3.0:1788875140.187904:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:3.0:1788875140.187917:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:11386:x1875771218005248:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875140.187954:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875140.187985:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82c5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d5f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.188065:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82c5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d5f expref: 32 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.188082:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82c5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d5f expref: 32 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.188103:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.188133:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875140.188138:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15c00, rc 0) 00000100:00100000:3.0:1788875140.188221:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11386:x1875771218005248:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 306us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.188228:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 148 00000100:00100000:2.0:1788875140.199588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.199743:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218005504 00000100:00100000:3.0:1788875140.199757:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218005504 00000100:00100000:2.0:1788875140.200138:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:2.0:1788875140.200150:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11386:x1875771218005504:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875140.200490:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:11386:x1875771218005504:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 342us (917us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788875140.200514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:1.0:1788875140.292996:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.293120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218005760 00000100:00100000:0.0:1788875140.293133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218005760 00000100:00100000:0.0:1788875140.293264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00100000:0.0:1788875140.293277:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:11396:x1875771218005760:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875140.293330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875140.293357:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d66 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875140.293489:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788875140.293657:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d66 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.293676:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:0.0:1788875140.293679:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875140.293686:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d66 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.296935:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1400, rc 0) 00000100:00100000:0.0:1788875140.297061:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11396:x1875771218005760:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 3778us (4071us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788875140.297073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 149 00000100:00100000:3.0:1788875140.302394:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875140.304509:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218005888 00000100:00100000:2.0:1788875140.304527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218005888 00000100:00100000:2.0:1788875140.304695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 150 00000100:00100000:2.0:1788875140.304708:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11396:x1875771218005888:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1788875140.304844:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.304878:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.304894:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.304913:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.304920:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.304926:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305046:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305056:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305063:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875140.305157:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305174:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305189:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305197:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305203:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875140.305208:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305216:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305462:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875140.305467:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875140.305474:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305481:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82c74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305497:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305503:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305516:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305522:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875140.305525:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305531:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305538:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875140.305541:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875140.305544:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305550:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305567:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305573:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305579:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305584:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875140.305587:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305601:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305608:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:2.0:1788875140.305610:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875140.305613:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.305618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875140.305998:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11396:x1875771218005888:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 1287us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875140.306010:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 150 00000100:00100000:3.0:1788875140.309064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.309459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218006144 00000100:00100000:0.0:1788875140.309472:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218006144 00000100:00100000:0.0:1788875140.309576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1788875140.309589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11396:x1875771218006144:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1788875140.310362:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:11396:x1875771218006144:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 771us (1306us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788875140.310371:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1788875140.345448:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.345574:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218006400 00000100:00100000:3.0:1788875140.345587:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218006400 00000100:00100000:3.0:1788875140.346273:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:3.0:1788875140.346289:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:11399:x1875771218006400:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875140.346324:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875140.346351:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d6d expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346458:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346475:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346489:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346505:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346512:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346537:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346696:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346704:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346711:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875140.346722:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788875140.346954:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346963:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346970:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.346977:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875140.346982:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347055:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347071:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875140.347074:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875140.347087:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347094:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347108:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347113:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347119:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347125:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875140.347128:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347133:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347141:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10903400) 00010000:00010000:3.0:1788875140.347143:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875140.347146:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347152:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347202:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 38 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347231:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 37 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.347240:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.347242:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875140.347245:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875140.347341:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11399:x1875771218006400:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1056us (1919us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788875140.347349:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 151 00000100:00100000:0.0:1788875140.351093:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.351253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218006528 00000100:00100000:3.0:1788875140.351268:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218006528 00000100:00100000:3.0:1788875140.351344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00100000:3.0:1788875140.351356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11399:x1875771218006528:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:3.0:1788875140.351460:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351482:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351499:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351535:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351543:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351563:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351570:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875140.351575:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351584:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351598:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.351602:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875140.351608:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.351615:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875140.351710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11399:x1875771218006528:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 356us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.351718:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 152 00000100:00100000:2.0:1788875140.356137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.356377:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218006784 00000100:00100000:0.0:1788875140.356389:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218006784 00000100:00100000:0.0:1788875140.356465:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:0.0:1788875140.356476:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11399:x1875771218006784:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:0.0:1788875140.357106:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:11399:x1875771218006784:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 629us (982us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788875140.357116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:3.0:1788875140.672088:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875140.672323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218007040 00000100:00100000:2.0:1788875140.672336:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218007040 00000100:00100000:2.0:1788875140.672479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00100000:2.0:1788875140.672493:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:11430:x1875771218007040:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1788875140.672528:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875140.672561:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.672720:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.672740:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.672824:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875140.672840:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788875140.673488:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d74 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.673518:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d74 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.673530:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.673545:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875140.673551:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:3.0:1788875140.673649:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11430:x1875771218007040:12345-192.168.202.7@tcp:101:cat.0 Request processed in 1159us (1574us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788875140.673670:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00100000:0.0:1788875140.682462:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.682810:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218007168 00000100:00100000:3.0:1788875140.682824:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218007168 00000100:00100000:3.0:1788875140.682973:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:3.0:1788875140.682986:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:2349:x1875771218007168:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875140.683010:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875140.683045:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d74 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.683070:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.683077:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875140.683518:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:2349:x1875771218007168:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 532us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875140.683528:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788875140.684931:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.685626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218007424 00000100:00100000:3.0:1788875140.685643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218007424 00000100:00100000:3.0:1788875140.685725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:3.0:1788875140.685738:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:11430:x1875771218007424:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:3.0:1788875140.686139:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11430:x1875771218007424:12345-192.168.202.7@tcp:35:cat.0 Request processed in 403us (1217us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788875140.686148:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:0.0:1788875140.759704:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.759974:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218007680 00000100:00100000:3.0:1788875140.760004:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218007680 00000100:00100000:3.0:1788875140.760088:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 154 00000100:00100000:3.0:1788875140.760101:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11436:x1875771218007680:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:3.0:1788875140.760147:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875140.760152:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788875140.760187:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d4a expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760214:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875140.760231:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875140.760250:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82cc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d7b expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760390:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760406:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 40 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760417:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760474:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 40 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.760492:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 40 pid: 8216 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875140.760508:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241079424:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875140.760656:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bff2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788875140.765258:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875140.765447:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241079424:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875140.765488:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875140.765626:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218007808 00000100:00100000:1.0:1788875140.765637:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218007808 00010000:00010000:1.0:1788875140.765707:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 41 pid: 8216 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875140.765758:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:1.0:1788875140.765823:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+41:2348:x1875771218007808:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875140.765845:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875140.765857:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 41 pid: 8216 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.765882:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 41 pid: 8216 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.765913:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82c9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d6d expref: 41 pid: 8216 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.765933:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875140.765938:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.765950:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.765960:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875140.766001:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875140.766075:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:2348:x1875771218007808:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 254us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875140.766083:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00010000:00010000:0.0:1788875140.766345:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.766355:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875140.766384:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788875140.766631:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82cc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 41 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.766652:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 40 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.766662:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875140.766665:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788875140.766669:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:0.0:1788875140.766705:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11436:x1875771218007680:12345-192.168.202.7@tcp:101:dd.0 Request processed in 6608us (7024us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788875140.766728:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 154 00000100:00100000:1.0:1788875140.777190:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875140.777337:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008064 00000100:00100000:0.0:1788875140.777351:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008064 00000100:00100000:0.0:1788875140.777423:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 155 00000100:00100000:0.0:1788875140.777443:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11436:x1875771218008064:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:0.0:1788875140.778004:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.778028:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875140.778043:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875140.778109:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788875140.778135:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb8a54cb reply state 00000000b5f9aed7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875140.778146:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875140.778526:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:11436:x1875771218008064:12345-192.168.202.7@tcp:36:dd.0 Request processed in 1092us (1350us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788875140.778536:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 155 00000020:00080000:0.0:1788875140.778542:0:11390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788875140.782821:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782846:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782854:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782860:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875140.782867:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782876:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782900:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875140.782904:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875140.782910:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875140.782917:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875140.878513:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875141.199885:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.200502:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008192 00000100:00100000:0.0:1788875141.200518:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008192 00000100:00100000:0.0:1788875141.200632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:0.0:1788875141.200646:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+42:11449:x1875771218008192:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:0.0:1788875141.200694:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875141.200745:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d82 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200875:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200910:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200929:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200936:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.200943:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.201066:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.201079:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 43 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.201088:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788875141.201409:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788875141.201563:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 43 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.201598:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 43 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.201616:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875771241079552:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875141.203371:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258600 going to sleep for 11 seconds 00000100:00100000:2.0:1788875141.218162:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.220850:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008448 00000100:00100000:3.0:1788875141.220896:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008448 00000100:00100000:3.0:1788875141.221012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1788875141.221027:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:5590:x1875771218008448:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788875141.223115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:5590:x1875771218008448:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 2077us (4954us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788875141.223134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:0.0:1788875141.224732:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875771241079552:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875141.225130:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875141.233521:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.236062:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008576 00000100:00100000:0.0:1788875141.236087:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008576 00010000:00010000:0.0:1788875141.236180:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 45 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.236257:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:0.0:1788875141.236271:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:2347:x1875771218008576:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875141.236292:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875141.236299:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 45 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236315:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 45 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236345:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82ccf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d7b expref: 45 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236389:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875141.236396:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236406:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236415:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.236473:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875141.236559:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:2347:x1875771218008576:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 291us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875141.236567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00010000:00010000:1.0:1788875141.237232:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237262:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875141.237327:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788875141.237333:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875141.237364:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237392:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237400:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237407:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237413:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.237418:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237438:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237452:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875141.237455:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875141.237459:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237476:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82ceb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237493:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237499:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237510:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.237513:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237519:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237526:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a0bc0d800) 00010000:00010000:1.0:1788875141.237529:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875141.237532:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237538:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d82cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237595:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d82 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237611:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d82 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.237627:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.237629:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875141.237632:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0000, rc 0) 00000100:00100000:1.0:1788875141.237689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:11449:x1875771218008192:12345-192.168.202.7@tcp:101:stat.0 Request processed in 37048us (37820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.237697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 156 00000100:00100000:1.0:1788875141.333986:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.334402:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008832 00000100:00100000:0.0:1788875141.334417:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008832 00000100:00100000:0.0:1788875141.334508:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 157 00000100:00100000:0.0:1788875141.334522:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:11456:x1875771218008832:12345-192.168.202.7@tcp:36:truncate.0 00010000:00010000:0.0:1788875141.334614:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875141.334650:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d82 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.334676:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875141.334694:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875141.335461:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.335481:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.335514:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875141.335574:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788875141.335600:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004457f1a reply state 00000000321cb41a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.335612:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875141.336369:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:11456:x1875771218008832:12345-192.168.202.7@tcp:36:truncate.0 Request processed in 1842us (2391us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788875141.336380:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 157 00000020:00080000:0.0:1788875141.336387:0:8216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788875141.343964:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.343988:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.343997:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.344004:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875141.344010:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.344030:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.344055:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875141.344058:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875141.344066:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.344073:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d82d00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875141.458818:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788875141.458860:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241079680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875141.458980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875141.459144:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241079680 00000100:00100000:3.0:1788875141.459242:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241079680 00000100:00100000:3.0:1788875141.459343:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788875141.459358:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241079680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875141.459410:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875141.459488:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241079680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875141.459496:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788875141.459554:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241079680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788875141.460082:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875141.510041:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.510174:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218008960 00000100:00100000:0.0:1788875141.510190:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218008960 00000100:00100000:0.0:1788875141.510321:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 158 00000100:00100000:0.0:1788875141.510335:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:11470:x1875771218008960:12345-192.168.202.7@tcp:101:stat.0 00010000:00010000:0.0:1788875141.510370:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875141.510400:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d89 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510509:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510528:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510542:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510582:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510589:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510596:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510712:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510722:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510729:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875141.510816:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788875141.510821:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875141.510857:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510874:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510883:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510890:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510909:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510916:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875141.510922:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510931:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510947:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875141.510951:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875141.510957:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510965:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510982:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510989:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.510995:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511000:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875141.511003:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511020:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511030:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a0bc0dc00) 00010000:00010000:0.0:1788875141.511032:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875141.511036:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511042:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511081:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 46 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511097:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 45 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.511105:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875141.511108:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875141.511110:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0200, rc 0) 00000100:00100000:0.0:1788875141.511202:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:11470:x1875771218008960:12345-192.168.202.7@tcp:101:stat.0 Request processed in 869us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875141.511211:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 158 00000100:00100000:2.0:1788875141.602953:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.603077:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218009216 00000100:00100000:1.0:1788875141.603091:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218009216 00000100:00100000:1.0:1788875141.603182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 159 00000100:00100000:1.0:1788875141.603195:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+45:11480:x1875771218009216:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875141.603222:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875141.603252:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d90 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875141.603390:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788875141.603569:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82d23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d90 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.603588:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:1.0:1788875141.603591:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875141.603598:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d90 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.603617:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34400, rc 0) 00000100:00100000:1.0:1788875141.603730:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:11480:x1875771218009216:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 537us (793us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788875141.603738:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 159 00000100:00100000:2.0:1788875141.608047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.609017:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218009472 00000100:00100000:1.0:1788875141.609034:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218009472 00000100:00100000:1.0:1788875141.609239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1788875141.609253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+46:11480:x1875771218009472:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1788875141.609643:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:11480:x1875771218009472:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 393us (1613us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788875141.609653:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:2.0:1788875141.690478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.690928:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218009728 00000100:00100000:0.0:1788875141.690944:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218009728 00000100:00100000:0.0:1788875141.691030:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00100000:0.0:1788875141.691045:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:11486:x1875771218009728:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875141.691109:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875141.691142:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d97 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.691439:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.691458:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 48 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.691469:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.691515:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 48 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.691532:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 48 pid: 11390 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.691549:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241079808:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875141.691869:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06258240 going to sleep for 11 seconds 00000100:00100000:0.0:1788875141.696869:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241079808:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875141.696913:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875141.697402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.697499:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218009856 00000100:00100000:1.0:1788875141.697511:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218009856 00010000:00010000:1.0:1788875141.697561:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 49 pid: 11390 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875141.697605:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:1.0:1788875141.697614:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+49:2347:x1875771218009856:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875141.697633:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875141.697639:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 49 pid: 11390 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.697649:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 49 pid: 11390 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.698027:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d82d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d89 expref: 49 pid: 11390 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.698063:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.698067:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.698076:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.698460:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.698504:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875141.698581:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+48:2347:x1875771218009856:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 966us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.698591:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00010000:00010000:0.0:1788875141.698700:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.698709:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875141.698744:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788875141.699217:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 49 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.699236:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 48 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.699247:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875141.699250:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788875141.699253:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1200, rc 0) 00000100:00100000:0.0:1788875141.699295:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+48:11486:x1875771218009728:12345-192.168.202.7@tcp:101:bash.0 Request processed in 8254us (8835us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788875141.699304:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 160 00000100:00100000:2.0:1788875141.708584:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.713346:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218010112 00000100:00100000:0.0:1788875141.713368:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218010112 00000100:00100000:0.0:1788875141.713466:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 161 00000100:00100000:0.0:1788875141.713479:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+48:11486:x1875771218010112:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:0.0:1788875141.714790:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.714820:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.714837:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875141.715256:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788875141.715318:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adedf3e0 reply state 000000003b90c142 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.715331:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875141.715504:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:11486:x1875771218010112:12345-192.168.202.7@tcp:36:bash.0 Request processed in 2022us (6929us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788875141.715515:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 161 00000020:00080000:0.0:1788875141.715521:0:11390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788875141.718102:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718398:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718407:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718412:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.718416:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718433:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718484:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.718488:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875141.718495:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.718501:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82d46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875141.721965:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.722161:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218010240 00000100:00100000:3.0:1788875141.722177:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218010240 00000100:00100000:3.0:1788875141.722573:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:3.0:1788875141.722586:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:11486:x1875771218010240:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875141.722622:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875141.722650:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82d4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0d9e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.722812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.722831:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 51 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.722842:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.722891:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 51 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.722931:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 51 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875141.722950:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241079936:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875141.723065:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0bff2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788875141.725096:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241079936:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875141.725143:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875141.727270:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.732334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218010368 00000100:00100000:3.0:1788875141.732352:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218010368 00010000:00010000:3.0:1788875141.732410:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 52 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875141.732533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:3.0:1788875141.732545:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:2348:x1875771218010368:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875141.732566:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875141.732574:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 52 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732589:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 52 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732618:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d82d38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d97 expref: 52 pid: 8216 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732639:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875141.732644:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732686:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732695:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.732860:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875141.732945:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:2348:x1875771218010368:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 402us (5689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875141.732954:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00010000:00010000:1.0:1788875141.733264:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.733276:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875141.733339:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788875141.733344:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875141.733372:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.733413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82d4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d9e expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.733443:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d9e expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.733452:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.733466:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875141.733471:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15200, rc 0) 00000100:00100000:1.0:1788875141.733506:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:11486:x1875771218010240:12345-192.168.202.7@tcp:101:bash.0 Request processed in 10924us (11559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.733513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:2.0:1788875141.736690:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.736807:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218010624 00000100:00100000:3.0:1788875141.736821:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218010624 00000100:00100000:3.0:1788875141.736889:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1788875141.736902:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:11486:x1875771218010624:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:3.0:1788875141.737236:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:11486:x1875771218010624:12345-192.168.202.7@tcp:35:bash.0 Request processed in 336us (570us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788875141.737244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:2.0:1788875141.835203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.836861:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218010880 00000100:00100000:0.0:1788875141.836882:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218010880 00000100:00100000:0.0:1788875141.836973:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 163 00000100:00100000:0.0:1788875141.836986:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:11496:x1875771218010880:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875141.837018:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875141.837050:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0da5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875141.837231:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788875141.837404:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0da5 expref: 53 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.837435:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:0.0:1788875141.837439:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875141.837446:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0da5 expref: 53 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.837465:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0000, rc 0) 00000100:00100000:0.0:1788875141.837557:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11496:x1875771218010880:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 574us (2368us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788875141.837564:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 163 00000100:00100000:2.0:1788875141.844679:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.844816:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218011008 00000100:00100000:0.0:1788875141.844830:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218011008 00000100:00100000:0.0:1788875141.844917:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:0.0:1788875141.844929:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11496:x1875771218011008:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:0.0:1788875141.845035:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845057:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845071:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845090:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845097:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845104:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845219:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845229:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845237:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875141.845292:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845325:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845331:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845338:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845344:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875141.845349:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845358:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845372:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875141.845375:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875141.845381:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845388:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845403:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845409:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845416:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845568:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875141.845572:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845578:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845587:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a0bc0dc00) 00010000:00010000:0.0:1788875141.845590:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875141.845593:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845599:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845615:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845621:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845627:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845631:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875141.845634:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845640:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845659:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875141.845662:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875141.845666:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875141.845671:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875141.846250:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11496:x1875771218011008:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 1319us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875141.846261:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 164 00000100:00100000:2.0:1788875141.848827:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.849730:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218011264 00000100:00100000:3.0:1788875141.849749:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218011264 00000100:00100000:3.0:1788875141.849870:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:3.0:1788875141.849883:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11496:x1875771218011264:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875141.850253:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:11496:x1875771218011264:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 371us (1438us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788875141.850262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:2.0:1788875141.899555:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.899722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218011520 00000100:00100000:1.0:1788875141.899736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218011520 00000100:00100000:1.0:1788875141.899848:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 165 00000100:00100000:1.0:1788875141.899861:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+53:11499:x1875771218011520:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875141.899896:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875141.899925:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dac expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900048:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900063:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900082:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900090:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900410:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35600/0x60858e6020d82d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900429:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35600/0x60858e6020d82d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900438:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35600/0x60858e6020d82d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875141.900451:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788875141.900587:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900596:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900604:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900610:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.900616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900625:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900641:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875141.900644:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875141.900649:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900670:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900689:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900695:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900701:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900707:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.900711:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900718:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900726:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875141.900729:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875141.900731:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.900737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.901094:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dac expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.901122:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35600/0x60858e6020d82d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dac expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.901139:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.901142:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875141.901145:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35600, rc 0) 00000100:00100000:1.0:1788875141.901349:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11499:x1875771218011520:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1489us (1806us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788875141.901359:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 165 00010000:00010000:3.0:1788875141.904312:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875141.910474:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875141.910526:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.910598:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218011648 00000100:00100000:1.0:1788875141.910611:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218011648 00000100:00100000:1.0:1788875141.910696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:1.0:1788875141.910708:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11499:x1875771218011648:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1788875141.910827:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910849:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910863:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910897:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910905:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910913:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910918:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875141.910942:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910952:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910967:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:1.0:1788875141.910970:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875141.910975:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875141.910983:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875141.911072:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11499:x1875771218011648:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 366us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.911080:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:3.0:1788875141.911755:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218011776 00000100:00100000:3.0:1788875141.911799:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218011776 00000100:00100000:3.0:1788875141.911850:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1788875141.911858:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:2349:x1875771218011776:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875141.911874:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875141.911897:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35600/0x60858e6020d82d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dac expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875141.911911:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875141.911916:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875141.911956:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:2349:x1875771218011776:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 100us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875141.911964:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1788875141.915729:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875141.916764:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012032 00000100:00100000:3.0:1788875141.916811:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012032 00000100:00100000:3.0:1788875141.916903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:3.0:1788875141.916917:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:11499:x1875771218012032:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875141.917541:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11499:x1875771218012032:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 623us (1824us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788875141.917550:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1788875141.921062:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875141.921146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875141.921413:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875141.921481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012160 00000100:00100000:0.0:1788875141.921496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012160 00000100:00100000:0.0:1788875141.921571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 298 00000100:00100000:0.0:1788875141.921582:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218012160:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875141.921688:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218012160:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 107us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875141.921697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 298 00000100:00100000:2.0:1788875141.933716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875141.933935:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012544 00000100:00100000:1.0:1788875141.933948:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012544 00000100:00100000:1.0:1788875141.934048:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00100000:1.0:1788875141.934060:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218012544:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875141.934175:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218012544:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 107us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.934183:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 153 00000100:00080000:2.0:1788875141.934549:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875141.942740:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012416 00000100:00100000:3.0:1788875141.942761:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012416 00000100:00100000:3.0:1788875141.942955:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012288 00000100:00100000:3.0:1788875141.942959:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012288 00000100:00100000:1.0:1788875141.943034:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:1.0:1788875141.943049:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218012416:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875141.943197:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218012416:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 152us (22049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.943236:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00080000:2.0:1788875141.953940:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875141.956740:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:3.0:1788875141.956761:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771218012288:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875141.956906:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771218012288:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 152us (35492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875141.956937:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00080000:3.0:1788875141.956995:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875141.966536:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241080192:0@lo:400:kworker.0 00000100:00100000:0.0:1788875141.966637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875141.966728:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788875141.966735:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241080320:0@lo:400:kworker.0 00000100:00100000:0.0:1788875141.966760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875141.967034:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241080064:0@lo:400:kworker.0 00000100:00100000:3.0:1788875141.967079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875141.967119:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241080576:0@lo:400:kworker.0 00000100:00100000:3.0:1788875141.967149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875141.967460:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875141.967468:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241080448:0@lo:400:kworker.0 00000100:00100000:3.0:1788875141.967497:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875141.967614:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080192 00000100:00100000:1.0:1788875141.967625:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080192 00000100:00100000:1.0:1788875141.967686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080320 00000100:00100000:1.0:1788875141.967689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080320 00000100:00100000:1.0:1788875141.967723:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080448 00000100:00100000:1.0:1788875141.967727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080448 00000100:00100000:1.0:1788875141.967747:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788875141.967757:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241080192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875141.967858:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241080192:12345-0@lo:400:kworker.0 Request processed in 102us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.967867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788875141.967933:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241080192:0@lo:400:kworker.0 00000100:00080000:1.0:1788875141.967962:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875141.967975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788875141.967982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241080320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875141.968016:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241080320:12345-0@lo:400:kworker.0 Request processed in 35us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.968023:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788875141.968048:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241080320:0@lo:400:kworker.0 00000100:00100000:1.0:1788875141.968066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788875141.968073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241080448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875141.968204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080064 00000100:00100000:0.0:1788875141.968707:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080064 00000100:00100000:0.0:1788875141.968754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788875141.968763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875141.968874:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a03e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241080064:12345-0@lo:400:kworker.0 Request processed in 113us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875141.968882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788875141.968940:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241080064:0@lo:400:kworker.0 00000100:00100000:2.0:1788875141.969089:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080576 00000100:00100000:2.0:1788875141.969095:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080576 00000100:00100000:2.0:1788875141.969148:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788875141.969157:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241080576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875141.969217:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241080576:12345-0@lo:400:kworker.0 Request processed in 52us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875141.969224:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788875141.969254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241080576:0@lo:400:kworker.0 00000100:00100000:1.0:1788875141.969444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875771241080448:12345-0@lo:400:kworker.0 Request processed in 1369us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875141.969453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788875141.970754:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241080448:0@lo:400:kworker.0 00000100:00100000:2.0:1788875142.108287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875142.116719:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012800 00000100:00100000:0.0:1788875142.116742:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012800 00000100:00100000:0.0:1788875142.116854:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:0.0:1788875142.116867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11517:x1875771218012800:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1788875142.116902:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875142.116929:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82da8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0db3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.117079:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82daf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.117098:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82daf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.117114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82daf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875142.117128:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788875142.117330:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82da8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0db3 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.117354:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82daf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0db3 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.117386:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:0.0:1788875142.117390:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788875142.117395:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0a00, rc 0) 00000100:00100000:0.0:1788875142.117507:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11517:x1875771218012800:12345-192.168.202.7@tcp:101:cat.0 Request processed in 642us (9234us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788875142.117516:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:2.0:1788875142.135485:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875142.136401:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218012928 00000100:00100000:0.0:1788875142.136427:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218012928 00000100:00100000:0.0:1788875142.136521:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:0.0:1788875142.136533:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11518:x1875771218012928:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875142.136571:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875142.136600:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dba expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136690:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136709:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136727:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875142.136820:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788875142.136824:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875142.136849:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136908:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d82dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dba expref: 59 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136930:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dba expref: 58 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875142.136939:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875142.136942:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875142.136946:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1e00, rc 0) 00000100:00100000:0.0:1788875142.137022:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11518:x1875771218012928:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 491us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875142.137030:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 168 00000100:00100000:2.0:1788875142.153916:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875142.154122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013312 00000100:00100000:3.0:1788875142.154137:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013312 00000100:00100000:3.0:1788875142.154227:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875142.154239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11518:x1875771218013312:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875142.154897:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11518:x1875771218013312:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 657us (991us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788875142.154907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:2.0:1788875142.158399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875142.158514:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013440 00000100:00100000:3.0:1788875142.158526:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013440 00000100:00100000:3.0:1788875142.158661:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1788875142.158673:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05655850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11518:x1875771218013440:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:3.0:1788875142.158694:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788875142.158727:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d9e expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875142.158753:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0db3 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875142.158843:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82c5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d5f expref: 57 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875142.158866:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903b00) 00010000:00010000:3.0:1788875142.158881:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875142.158955:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05655850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:11518:x1875771218013440:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 283us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875142.158963:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1788875142.169042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875142.170439:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013568 00000100:00100000:3.0:1788875142.170458:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013568 00000100:00100000:3.0:1788875142.170597:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:3.0:1788875142.170611:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:11518:x1875771218013568:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:3.0:1788875142.170759:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875142.170809:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875142.170827:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875142.171122:0:11390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788875142.173518:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:11518:x1875771218013568:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 2893us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875142.173536:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 169 00000100:00100000:2.0:1788875142.191435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875142.191594:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013696 00000100:00100000:1.0:1788875142.191609:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013696 00000100:00100000:1.0:1788875142.191736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 170 00000100:00100000:1.0:1788875142.191749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:11520:x1875771218013696:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875142.191816:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875142.191849:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82dd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dc1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.191944:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.191963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.191978:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.191996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192003:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192008:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192191:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192201:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192242:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875142.192305:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788875142.192311:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875142.192337:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192353:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192363:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192370:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192378:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192385:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875142.192389:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192398:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192412:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875142.192416:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875142.192431:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192450:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192468:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192475:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192481:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192486:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875142.192490:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192496:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192505:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875142.192508:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875142.192511:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192517:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d82dd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192583:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875142.192598:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:1.0:1788875142.192600:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875142.192603:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34a00, rc 0) 00000100:00100000:1.0:1788875142.192676:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11520:x1875771218013696:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 930us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875142.192686:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 170 00000004:00080000:2.0:1788875142.480950:0:7927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357346173808ns, next at 358346170543ns, rc = 0 00000100:00100000:2.0:1788875142.480991:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875142.481021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0476ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241080704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875142.482292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875142.482436:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080704 00000100:00100000:3.0:1788875142.482448:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080704 00000100:00100000:3.0:1788875142.482557:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788875142.482569:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241080704:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788875142.482895:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788875142.486242:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875142.486396:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241080704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3824us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875142.486408:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788875142.486995:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0476ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241080704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875142.932562:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788875143.011889:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788875143.011896:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788875143.011957:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788875143.011963:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788875143.012103:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a012ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241080832:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788875143.012210:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d38f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788875143.028474:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a012ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241080832:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788875143.045729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.045883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013824 00000100:00100000:3.0:1788875143.045893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013824 00000100:00100000:3.0:1788875143.045954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:3.0:1788875143.045965:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11531:x1875771218013824:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875143.045997:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1788875143.046154:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875143.046250:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11531:x1875771218013824:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 286us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.046274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:0.0:1788875143.050688:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.050803:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218013952 00000100:00100000:3.0:1788875143.050814:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218013952 00000100:00100000:3.0:1788875143.050870:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:3.0:1788875143.050881:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11531:x1875771218013952:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788875143.050960:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.050980:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.050993:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051027:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051035:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051042:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051070:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051079:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051086:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875143.051125:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788875143.051129:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875143.051142:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051154:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051161:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051168:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051184:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875143.051189:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051197:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051211:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:3.0:1788875143.051214:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875143.051219:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051225:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82dee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051239:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051244:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051250:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051255:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875143.051258:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051264:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051283:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e5a10903000) 00010000:00010000:3.0:1788875143.051287:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875143.051290:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051296:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82df5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051312:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051318:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051324:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051330:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875143.051333:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051339:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051347:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:3.0:1788875143.051349:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875143.051352:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.051358:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.051464:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11531:x1875771218013952:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 584us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.051472:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:3.0:1788875143.065394:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875143.070391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218014208 00000100:00100000:0.0:1788875143.070417:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218014208 00000100:00100000:0.0:1788875143.070489:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:0.0:1788875143.070501:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11531:x1875771218014208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875143.070520:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875143.070541:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dc8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070642:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070667:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070679:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875143.070691:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788875143.070899:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070907:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070915:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070921:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.070925:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070933:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070945:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:0.0:1788875143.070948:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875143.070953:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070960:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.070998:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e03 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.071016:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:0.0:1788875143.071019:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875143.071023:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.071033:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0a00, rc 0) 00000100:00100000:0.0:1788875143.071101:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 603us (5720us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788875143.071110:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 173 00000100:00100000:1.0:1788875143.079685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.079732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218014336 00000100:00100000:1.0:1788875143.079743:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218014336 00000100:00100000:1.0:1788875143.079807:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 174 00000100:00100000:1.0:1788875143.079818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014336:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788875143.079851:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788875143.079947:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014336:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.079955:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 174 00000040:00080000:2.0:1788875143.090226:0:12519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875143.090242:0:12519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875143.090288:0:12519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788875143.090294:0:12519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788875143.095663:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.095980:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218014592 00000100:00100000:1.0:1788875143.095991:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218014592 00000100:00100000:1.0:1788875143.096051:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:1.0:1788875143.096061:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875143.096090:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875143.096100:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788875143.096128:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d82dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dba expref: 58 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.096146:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875143.096151:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875143.096165:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82e18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dcf expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875143.097058:0:8216:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788875143.104206:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.104245:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.104258:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.104341:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d82e18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dcf expref: 60 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.105132:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dcf expref: 59 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.105143:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:1.0:1788875143.105147:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875143.105156:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34200, rc 0) 00000100:00100000:1.0:1788875143.105247:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11531:x1875771218014592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 9186us (9593us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788875143.105257:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 175 00000100:00100000:3.0:1788875143.112327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875143.112426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218014848 00000100:00100000:0.0:1788875143.112436:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218014848 00000100:00100000:0.0:1788875143.112502:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 176 00000100:00100000:0.0:1788875143.112513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11531:x1875771218014848:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875143.112574:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875143.112600:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d82e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dcf expref: 59 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112621:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10bf8200) 00010000:00010000:0.0:1788875143.112639:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875143.112662:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112675:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112686:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112717:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112724:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112730:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112970:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.112992:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113000:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.113011:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113019:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113029:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875143.113032:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875143.113036:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113042:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d82e2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113060:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113067:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113073:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113078:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.113081:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113088:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113096:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x619c190e (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875143.113099:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875143.113102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.113108:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x619c190e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875143.113189:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cda5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014848:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 677us (874us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788875143.113197:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 176 00000100:00100000:0.0:1788875143.119003:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.119135:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218014976 00000100:00100000:3.0:1788875143.119148:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218014976 00000100:00100000:3.0:1788875143.119219:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 177 00000100:00100000:3.0:1788875143.119241:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11531:x1875771218014976:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875143.119261:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875143.119482:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82e3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0dd6 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119522:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119537:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119549:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119650:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82e3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 60 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119672:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 59 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.119693:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875143.119696:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788875143.119699:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788875143.119768:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11531:x1875771218014976:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 540us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.119798:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 177 00000100:00100000:0.0:1788875143.131579:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875143.131753:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218015232 00000100:00100000:2.0:1788875143.131764:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218015232 00000100:00100000:2.0:1788875143.131914:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 178 00000100:00100000:2.0:1788875143.131925:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11531:x1875771218015232:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788875143.132769:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.132814:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.132829:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875143.133163:0:8216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788875143.133174:0:8216:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357998400243ns, next at 358998398131ns, rc = 0 00000004:00010000:2.0:1788875143.134587:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e3a0ec2 reply state 00000000aa514fa7 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.134603:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788875143.134794:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11531:x1875771218015232:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 2866us (3221us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788875143.134803:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 178 00000100:00100000:0.0:1788875143.146718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:0.0:1788875143.146762:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146792:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146801:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146807:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.146813:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146821:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146843:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:0.0:1788875143.146846:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788875143.146851:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.146857:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82e49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875143.157719:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000020:00080000:2.0:1788875143.157765:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a06258f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788875143.157799:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a3d10ee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a06258180 00000020:00080000:2.0:1788875143.157803:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a05607900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a02a2cc00 00000020:00080000:2.0:1788875143.157862:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788875143.158318:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1788875143.158462:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788875143.158487:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1788875143.158499:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:0.0:1788875143.158808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218015360 00000100:00100000:0.0:1788875143.158819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218015360 00000100:00100000:0.0:1788875143.158832:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788875143.158854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241080960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788875143.158922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875143.159046:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:0.0:1788875143.159056:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11531:x1875771218015360:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875143.159106:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875143.159129:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ddd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.159195:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.159212:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.159235:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:0.0:1788875143.159238:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875143.159242:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:0.0:1788875143.159290:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11531:x1875771218015360:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 235us (12585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875143.159297:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 179 00000100:00100000:2.0:1788875143.159694:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241080960 00000100:00100000:2.0:1788875143.159701:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241080960 00000100:00100000:2.0:1788875143.159743:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788875143.159751:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241080960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788875143.159791:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788875143.159817:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa01184, atime: 0x6aa01184, ctime: 0x6aa01184, blocks: 0x1 00010000:00010000:2.0:1788875143.159824:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.159839:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788875143.159843:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.159848:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.159862:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.159873:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.159881:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.159898:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788875143.160466:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241080960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 714us (1542us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788875143.160481:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788875143.160510:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875143.160516:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.160524:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875143.160529:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.160538:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.160554:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.160561:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d82e57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.160580:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875143.160582:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875143.160584:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788875143.161909:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a34ee3100/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788875143.161922:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241080960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788875143.165811:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.165947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218015488 00000100:00100000:3.0:1788875143.165959:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218015488 00000100:00100000:3.0:1788875143.166033:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1788875143.166043:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2350:x1875771218015488:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788875143.166386:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218015488:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 344us (584us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788875143.166394:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00080000:0.0:1788875143.166643:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875143.171845:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875143.171881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218015744 00000100:00100000:0.0:1788875143.171890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218015744 00000100:00100000:0.0:1788875143.171939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:0.0:1788875143.171950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11531:x1875771218015744:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788875143.174514:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11531:x1875771218015744:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 2556us (2668us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788875143.174538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:1.0:1788875143.179650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875143.180927:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016000 00000100:00100000:2.0:1788875143.180939:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016000 00000100:00100000:2.0:1788875143.181005:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00100000:2.0:1788875143.181016:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11531:x1875771218016000:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788875143.183510:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11531:x1875771218016000:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 2483us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875143.183527:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 180 00000100:00100000:2.0:1788875143.209995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.210079:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016128 00000100:00100000:1.0:1788875143.210103:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016128 00000100:00100000:1.0:1788875143.210166:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 181 00000100:00100000:1.0:1788875143.210177:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11531:x1875771218016128:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875143.210196:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875143.210219:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82e5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0de4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210314:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210331:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210345:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875143.210381:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875143.210399:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210438:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34000/0x60858e6020d82e5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0de4 expref: 23 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210474:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0de4 expref: 22 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.210482:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875143.210485:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788875143.210489:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35200, rc 0) 00000100:00100000:1.0:1788875143.210557:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218016128:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 382us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.210565:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 181 00000100:00100000:1.0:1788875143.219314:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.219470:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016256 00000100:00100000:3.0:1788875143.219482:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016256 00000100:00100000:3.0:1788875143.219543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:3.0:1788875143.219554:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771218016256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875143.219571:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875143.219591:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0deb expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875143.219619:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa01187, blocks: 0x1 00010000:00010000:3.0:1788875143.219639:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788875143.219644:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875143.219662:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.219682:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.219696:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875143.219751:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771218016256:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 199us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.219758:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1788875143.238675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.238809:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016512 00000100:00100000:3.0:1788875143.238821:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016512 00000100:00100000:3.0:1788875143.238883:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 182 00000100:00100000:3.0:1788875143.238895:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218016512:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788875143.239008:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218016512:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 115us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.239016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 182 00000100:00100000:2.0:1788875143.251787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.252299:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016640 00000100:00100000:3.0:1788875143.252311:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016640 00000100:00100000:2.0:1788875143.252440:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875143.252452:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:11531:x1875771218016640:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875143.252469:0:6901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875143.252488:0:6901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0df2 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.252516:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.252523:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.252526:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.252530:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.252557:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.252568:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 9 pid: 6696 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.252590:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241081088:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875143.252679:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788875143.257057:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875143.257094:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016768 00000100:00100000:2.0:1788875143.257102:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016768 00010000:00010000:2.0:1788875143.257146:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 10 pid: 6696 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.257187:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:2.0:1788875143.257198:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2348:x1875771218016768:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875143.257214:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875143.257239:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 10 pid: 6696 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.257254:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 10 pid: 6696 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.257279:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.257284:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.257292:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 10 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.257304:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 10 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.257359:0:8459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 10 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.257373:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241081216:192.168.202.7@tcp:105: 00000100:00100000:2.0:1788875143.257463:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585af00 going to sleep for 11 seconds 00010000:00010000:3.0:1788875143.257644:0:6901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c252e3/0x60858e6020d82e6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0deb expref: 10 pid: 6696 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.257661:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241081088:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875143.257687:0:6901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.257709:0:6901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:3.0:1788875143.257756:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:11531:x1875771218016640:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5306us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.257765:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:3.0:1788875143.271207:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241081216:192.168.202.7@tcp:105: 00010000:00010000:3.0:1788875143.271246:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875143.271322:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218016768:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 14124us (14274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.271334:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:3.0:1788875143.278166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.278251:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218016896 00000100:00100000:1.0:1788875143.278264:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218016896 00002000:00100000:1.0:1788875143.278322:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e5a3d04ad80 x1875771218016896/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:49/0 lens 504/0 e 0 to 0 dl 1788875154 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788875143.278333:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d04ad80 with x1875771218016896 ext(0->8) 00002000:00010000:1.0:1788875143.278339:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d04ad80 00000100:00100000:1.0:1788875143.278377:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1788875143.278389:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218016896:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788875143.278897:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2348:x1875771218016896:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 508us (742us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788875143.278905:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00002000:00100000:1.0:1788875143.278912:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e5a3d04ad80 x1875771218016896/t4294967314(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:49/0 lens 504/448 e 0 to 0 dl 1788875154 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788875143.278934:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3d04ad80 with x1875771218016896 ext(0->8) 00002000:00010000:1.0:1788875143.278938:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3d04ad80 00000100:00100000:2.0:1788875143.286806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.286934:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017024 00000100:00100000:3.0:1788875143.286944:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017024 00000100:00100000:3.0:1788875143.287005:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 183 00000100:00100000:3.0:1788875143.287015:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218017024:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788875143.357602:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218017024:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 70576us (70827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.357618:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 183 00000001:00080000:3.0:1788875143.357654:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788875143.357674:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1788875143.357688:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788875143.358361:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788875143.358375:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788875143.358524:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875143.358540:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241081344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788875143.358611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875143.358665:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241081344 00000100:00100000:3.0:1788875143.358673:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241081344 00000100:00100000:3.0:1788875143.358720:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788875143.358729:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241081344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788875143.358919:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788875143.358923:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788875143 00002000:00010000:3.0:1788875143.358926:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788875143.358928:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788875143 -> 1788875143 00002000:00010000:3.0:1788875143.358930:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788875143.358971:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241081344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (359us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788875143.358978:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788875143.359020:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5905d71180/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788875143.359026:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5905d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241081344:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788875143.360675:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875143.370583:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.372027:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017152 00000100:00100000:3.0:1788875143.372041:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017152 00000100:00100000:3.0:1788875143.372129:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1788875143.372140:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2348:x1875771218017152:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788875143.400098:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788875143.400123:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788875143.400448:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218017152:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 28302us (29864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.400459:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:3.0:1788875143.404001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875143.404435:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017408 00000100:00100000:0.0:1788875143.404446:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017408 00000100:00100000:0.0:1788875143.404541:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 184 00000100:00100000:0.0:1788875143.404553:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11531:x1875771218017408:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875143.404609:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875143.404638:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35200/0x60858e6020d82e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0de4 expref: 18 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.404667:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:0.0:1788875143.404673:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875143.404707:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.404721:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.404731:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875143.405034:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc3d43a reply state 00000000be5f4de0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875143.405044:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875143.405157:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11531:x1875771218017408:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 606us (1169us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788875143.405165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 184 00000100:00100000:2.0:1788875143.409431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:1.0:1788875143.409954:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.409969:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.409977:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.409983:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875143.409988:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.409997:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.410014:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875143.410017:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875143.410022:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.410029:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d82e7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.410174:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017536 00000100:00100000:3.0:1788875143.410184:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017536 00000100:00100000:3.0:1788875143.410339:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:3.0:1788875143.410364:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218017536:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788875143.410636:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788875143.410640:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788875143 -> 1788875142 00002000:00010000:3.0:1788875143.410643:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788875140 00002000:00010000:3.0:1788875143.410645:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788875143 -> 1788875142 00002000:00010000:3.0:1788875143.410647:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788875143.410732:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218017536:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 370us (1322us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788875143.410741:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:2.0:1788875143.414274:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875143.414437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017792 00000100:00100000:0.0:1788875143.414448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017792 00000100:00100000:0.0:1788875143.414496:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 185 00000100:00100000:0.0:1788875143.414506:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11531:x1875771218017792:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788875143.414580:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.414596:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 18 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.414606:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.414639:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 18 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.414654:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 18 pid: 11390 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875143.414669:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241081472:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875143.414792:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3312ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788875143.418140:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.418319:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241081472:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875143.418346:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.418434:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218017920 00000100:00100000:3.0:1788875143.418441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218017920 00010000:00010000:3.0:1788875143.418479:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 19 pid: 11390 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.418520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:3.0:1788875143.418528:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:2347:x1875771218017920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875143.418544:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875143.418550:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 19 pid: 11390 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418562:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 19 pid: 11390 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418584:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dd6 expref: 19 pid: 11390 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418600:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:3.0:1788875143.418610:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418619:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418627:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.418655:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875143.418712:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2347:x1875771218017920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 184us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875143.418719:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00010000:00010000:1.0:1788875143.418882:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418890:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418918:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418925:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418931:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418936:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875143.418941:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418948:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418956:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875143.418959:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788875143.418962:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.418968:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d82e81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875143.419004:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:11531:x1875771218017792:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 4500us (4742us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788875143.419016:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 185 00000100:00100000:3.0:1788875143.421960:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875143.422114:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018048 00000100:00100000:2.0:1788875143.422125:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018048 00000100:00100000:2.0:1788875143.422189:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1788875143.422209:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2349:x1875771218018048:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788875143.422260:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.422284:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 8 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.422292:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875143.422297:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875143.422301:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.422360:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 8 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.422375:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 8 pid: 6901 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.422390:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241081600:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875143.422486:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788875143.426433:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241081600:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875143.426468:0:6901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.428719:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.428957:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018176 00000100:00100000:1.0:1788875143.428967:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018176 00010000:00010000:1.0:1788875143.429008:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875143.429046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 71 00000100:00100000:1.0:1788875143.429054:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771218018176:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875143.429070:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875143.429107:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.429120:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.429143:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be4d73a2/0x60858e6020d82e73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df2 expref: 9 pid: 6901 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.429160:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788875143.429164:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788875143.429171:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.429181:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.429236:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875143.429297:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218018176:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 243us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.429304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 71 00010000:00010000:2.0:1788875143.429382:0:6901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429393:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429427:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429437:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429456:0:6901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429463:0:6901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875143.429468:0:6901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429477:0:6901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429488:0:6901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.429496:0:6901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40ab290/0x60858e6020d82e88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875143.429541:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2349:x1875771218018048:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 7334us (7595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875143.429549:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:0.0:1788875143.433031:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.433132:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018432 00000100:00100000:3.0:1788875143.433144:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018432 00000100:00100000:3.0:1788875143.433215:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 186 00000100:00100000:3.0:1788875143.433225:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+17:11531:x1875771218018432:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788875143.433323:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433346:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433360:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433635:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433668:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433678:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433711:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.433726:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 18 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.433741:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3525b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241081728:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875143.433868:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788875143.438216:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.438298:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018560 00000100:00100000:1.0:1788875143.438307:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018560 00010000:00010000:1.0:1788875143.438363:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 19 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875143.438402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:1.0:1788875143.438420:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:2347:x1875771218018560:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875143.438435:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875143.438444:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 19 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.438457:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 19 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.438482:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:1.0:1788875143.438488:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.438498:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.438506:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.438547:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875143.438609:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:2347:x1875771218018560:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 190us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.438616:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00010000:00010000:3.0:1788875143.441224:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d82e50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ddd expref: 18 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.441250:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3525b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241081728:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875143.441275:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.441284:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.441290:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875143.441498:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788875143.441754:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788875143.442075:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788875143.442301:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11390:1875771241081856:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788875143.442367:0:11390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875143.442464:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a11722600 going to sleep for 11 seconds 00000100:00100000:1.0:1788875143.443970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241081856 00000100:00100000:1.0:1788875143.443983:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241081856 00000100:00100000:1.0:1788875143.444078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788875143.444100:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11390:x1875771241081856:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788875143.444223:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11390:x1875771241081856:12345-0@lo:1000:mdt00_004.0 Request processed in 134us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.444230:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788875143.444314:0:11390:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788875143.444320:0:11390:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5905d71180, transno 4294967315 00000100:00100000:0.0:1788875143.444345:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11390:1875771241081856:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788875143.444925:0:11390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788875143.445006:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11390:1875771241081984:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788875143.445053:0:11390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875143.445742:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3312ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788875143.445827:0:11970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241081984 00000100:00100000:3.0:1788875143.445836:0:11970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241081984 00000100:00100000:3.0:1788875143.445875:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788875143.445883:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11390:x1875771241081984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788875143.446165:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11390:x1875771241081984:12345-0@lo:1000:mdt00_004.0 Request processed in 280us (1110us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788875143.446174:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788875143.446380:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11390:1875771241081984:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788875143.446430:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446441:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446450:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446457:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.446461:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446469:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446486:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903000) 00010000:00010000:0.0:1788875143.446489:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875143.446494:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446501:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d82e96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446543:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446549:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446555:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446560:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875143.446563:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446569:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446578:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:0.0:1788875143.446581:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788875143.446584:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446589:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d82dcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446611:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446624:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446634:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446673:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875143.446688:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 21 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875143.446701:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241082112:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875143.446852:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03deef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788875143.451403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875143.452031:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018688 00000100:00100000:1.0:1788875143.452041:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018688 00010000:00010000:1.0:1788875143.452255:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 22 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875143.452353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:1.0:1788875143.452364:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2347:x1875771218018688:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875143.452380:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875143.452388:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 22 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.452403:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 22 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.452449:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:1.0:1788875143.452467:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.452478:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.452486:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875143.452505:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875143.452562:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2347:x1875771218018688:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 200us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875143.452569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00010000:00010000:3.0:1788875143.452670:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34a00/0x60858e6020d82de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0dc1 expref: 21 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875143.452688:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3f7f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241082112:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875143.452707:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452717:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452723:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452736:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452742:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452749:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452755:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875143.452765:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452791:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452801:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:3.0:1788875143.452805:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875143.452808:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452814:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d82e9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452824:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452830:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452835:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452841:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875143.452843:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452849:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452855:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10903400) 00010000:00010000:3.0:1788875143.452857:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788875143.452864:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.452870:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82e8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875143.453159:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788875143.453165:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875143.453702:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788875143.453710:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788875143.453821:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11531:x1875771218018432:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 20595us (20799us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788875143.453831:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 186 00000020:00080000:3.0:1788875143.453835:0:11390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788875143.457860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875143.457974:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218018944 00000100:00100000:3.0:1788875143.457986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218018944 00000100:00100000:3.0:1788875143.458042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1788875143.458053:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11531:x1875771218018944:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788875143.458797:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788875143.458903:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788875143.458949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.458968:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.458982:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.458991:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.459009:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.459016:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875143.459042:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788875143.459155:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11531:x1875771218018944:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1101us (1304us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788875143.459163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000020:00080000:3.0:1788875143.459169:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788875143.459592:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875143.459600:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.459607:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875143.459618:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.459626:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.459640:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e5a10903600) 00010000:00010000:2.0:1788875143.459643:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788875143.459648:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.459655:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ea4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875143.459686:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875143.459688:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875143.459690:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875143.949953:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875144.985744:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788875145.113981:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788875145.114003:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000040:00080000:0.0:1788875145.116381:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875145.116400:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788875145.116438:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788875145.116447:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788875145.245462:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.247324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218019200 00000100:00100000:1.0:1788875145.247338:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218019200 00000100:00100000:1.0:1788875145.247442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 187 00000100:00100000:1.0:1788875145.247452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:11550:x1875771218019200:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875145.247478:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875145.247501:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0df9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.247599:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d82eb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.247613:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d82eb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.247626:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d82eb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875145.247656:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788875145.247969:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df9 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.247987:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d82eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df9 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788875145.248027:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788875145.248648:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875145.248652:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788875145.248656:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34e00, rc 0) 00000100:00100000:1.0:1788875145.248731:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11550:x1875771218019200:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1280us (3279us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788875145.248739:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 187 00000100:00100000:1.0:1788875145.254509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.254604:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218019328 00000100:00100000:2.0:1788875145.254615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218019328 00000100:00100000:2.0:1788875145.254682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 188 00000100:00100000:2.0:1788875145.254693:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11550:x1875771218019328:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:2.0:1788875145.254819:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.254837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.254850:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.254866:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.254886:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.254893:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255125:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255135:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255143:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875145.255184:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255197:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255205:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255213:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255220:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.255224:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255232:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255252:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875145.255255:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.255260:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255268:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255280:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255287:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255293:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255299:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.255302:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255308:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255316:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045bae00) 00010000:00010000:2.0:1788875145.255318:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.255322:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255328:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255356:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255363:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255369:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255375:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.255378:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255385:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255404:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875145.255407:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.255410:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.255416:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.255508:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11550:x1875771218019328:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 815us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875145.255517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 188 00000100:00100000:2.0:1788875145.312128:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.312167:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218019584 00000100:00100000:2.0:1788875145.312177:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218019584 00000100:00100000:2.0:1788875145.312244:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 189 00000100:00100000:2.0:1788875145.312255:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+24:11553:x1875771218019584:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875145.312277:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875145.312300:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e00 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312372:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312419:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312431:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312446:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312453:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312459:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312721:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312729:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312736:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875145.312757:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788875145.312867:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312875:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312881:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312887:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.312891:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312898:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312911:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875145.312914:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.312919:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312925:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312935:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312941:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312956:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312961:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.312964:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312971:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312979:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875145.312982:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.312985:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.312990:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82ee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.313030:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 27 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.313044:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 26 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.313051:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:2.0:1788875145.313053:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875145.313056:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875145.313114:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11553:x1875771218019584:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 860us (1001us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788875145.313131:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 189 00000100:00100000:3.0:1788875145.322477:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875145.322879:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218019712 00000100:00100000:0.0:1788875145.322890:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218019712 00000100:00100000:0.0:1788875145.322947:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:0.0:1788875145.322957:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3525bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11553:x1875771218019712:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1788875145.323027:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323046:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323060:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323088:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323105:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323437:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323443:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875145.323447:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323455:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323469:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:0.0:1788875145.323472:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875145.323478:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875145.323483:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d82ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.323572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3525bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11553:x1875771218019712:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 616us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875145.323578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 190 00000100:00100000:1.0:1788875145.337574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875145.337880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218019968 00000100:00100000:3.0:1788875145.337889:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218019968 00000100:00100000:3.0:1788875145.337936:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:3.0:1788875145.337946:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11553:x1875771218019968:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875145.338274:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:11553:x1875771218019968:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 328us (710us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788875145.338283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1788875145.388545:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.388664:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020224 00000100:00100000:2.0:1788875145.388674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020224 00000100:00100000:2.0:1788875145.388735:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:2.0:1788875145.388747:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:11078:x1875771218020224:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1788875145.388786:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875145.388807:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82eff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e07 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.388892:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.388904:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 28 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.388911:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.388939:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 28 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.388948:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 28 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.388959:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241082240:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875145.389050:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03243780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875145.397135:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241082240:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875145.397263:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.398753:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.398895:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020352 00000100:00100000:1.0:1788875145.398903:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020352 00010000:00010000:1.0:1788875145.398945:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 29 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875145.398975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 74 00000100:00100000:1.0:1788875145.398985:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:2348:x1875771218020352:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875145.399000:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875145.399006:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 29 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399030:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 29 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399051:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e00 expref: 29 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399075:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875145.399081:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399092:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399099:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.399137:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875145.399202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:2348:x1875771218020352:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 218us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875145.399209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 74 00010000:00010000:3.0:1788875145.399583:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.399591:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875145.399622:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788875145.399812:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82eff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.399828:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.399837:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875145.399840:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875145.399843:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:3.0:1788875145.399872:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:11078:x1875771218020224:12345-192.168.202.7@tcp:101:bash.0 Request processed in 11128us (11338us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788875145.399879:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 191 00000100:00100000:0.0:1788875145.403173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.403329:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020608 00000100:00100000:2.0:1788875145.403339:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020608 00000100:00100000:2.0:1788875145.403408:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 192 00000100:00100000:2.0:1788875145.403419:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:11078:x1875771218020608:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:2.0:1788875145.403702:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.403719:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.403731:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875145.403824:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788875145.403854:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e64f4af0 reply state 00000000050f3c3d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.403863:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788875145.403911:0:8216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788875145.404023:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11078:x1875771218020608:12345-192.168.202.7@tcp:36:bash.0 Request processed in 605us (859us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788875145.404031:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 192 00000020:00080000:2.0:1788875145.404036:0:8216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788875145.407705:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.407725:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.407733:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.407739:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875145.407745:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.407753:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.408009:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.408089:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020736 00000100:00100000:1.0:1788875145.408099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020736 00000100:00100000:1.0:1788875145.408183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 193 00000100:00100000:1.0:1788875145.408196:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11078:x1875771218020736:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875145.408230:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875145.408253:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e0e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.408337:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e0e expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.408353:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e0e expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.408375:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875145.408379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788875145.408383:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34800, rc 0) 00000100:00100000:1.0:1788875145.408455:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+33:11078:x1875771218020736:12345-192.168.202.7@tcp:101:bash.0 Request processed in 262us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875145.408462:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 193 00010000:00010000:3.0:1788875145.409149:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875145.409152:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875145.409158:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.409166:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.416478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.416564:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020864 00000100:00100000:1.0:1788875145.416575:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020864 00000100:00100000:1.0:1788875145.416647:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:1.0:1788875145.416669:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:11078:x1875771218020864:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875145.416688:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875145.416711:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e15 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788875145.416742:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa01186, atime: 0x6aa01184, ctime: 0x6aa01186, blocks: 0xb 00010000:00010000:1.0:1788875145.416766:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788875145.416803:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875145.416812:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.416851:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.416865:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35400, rc 0) 00000100:00100000:1.0:1788875145.416920:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:11078:x1875771218020864:12345-192.168.202.7@tcp:101:bash.0 Request processed in 262us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875145.416927:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00080000:2.0:1788875145.417799:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875145.420288:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875145.420423:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218020992 00000100:00100000:3.0:1788875145.420434:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218020992 00002000:00010000:3.0:1788875145.420484:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788875145.420490:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3628a680 with x1875771218020992 ext(0->18446744073709551615) 00002000:00010000:3.0:1788875145.420503:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3628a680. 00000100:00100000:3.0:1788875145.420544:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1788875145.420557:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218020992:12345-192.168.202.7@tcp:10:bash.0 00002000:00010000:3.0:1788875145.420937:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788875145.420942:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788875142 -> 1788875145 00002000:00010000:3.0:1788875145.420945:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788875140 -> 1788875140 00002000:00010000:3.0:1788875145.420947:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788875142 -> 1788875145 00002000:00010000:3.0:1788875145.420950:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788875145.421003:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771218020992:12345-192.168.202.7@tcp:10:bash.0 Request processed in 448us (728us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788875145.421011:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00002000:00010000:3.0:1788875145.421015:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788875145.421018:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3628a680 with x1875771218020992 ext(0->18446744073709551615) 00002000:00010000:3.0:1788875145.421023:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3628a680. 00000100:00100000:0.0:1788875145.513986:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875145.514191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218021120 00000100:00100000:3.0:1788875145.514203:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218021120 00000100:00100000:3.0:1788875145.514264:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:3.0:1788875145.514275:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11567:x1875771218021120:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:3.0:1788875145.514347:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.514362:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.514372:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.514553:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.514561:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.514568:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516556:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516576:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516597:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788875145.516644:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516819:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516828:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516835:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516841:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.516846:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516854:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516867:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875145.516870:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.516874:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516880:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516896:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516907:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516913:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516918:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.516921:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516927:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516936:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10903400) 00010000:00010000:2.0:1788875145.516939:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.516942:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516947:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516962:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516968:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516972:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516976:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.516984:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516990:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.516997:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:2.0:1788875145.516999:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.517002:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.517007:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.517308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11567:x1875771218021120:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 3028us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875145.517318:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 194 00000100:00100000:0.0:1788875145.582325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.582423:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218021376 00000100:00100000:1.0:1788875145.582433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218021376 00000100:00100000:1.0:1788875145.582491:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:1.0:1788875145.582503:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+32:11570:x1875771218021376:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875145.582524:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875145.582546:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e1c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582627:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582669:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582687:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.582722:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583205:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583216:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583223:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875145.583233:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788875145.583322:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583329:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583334:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583339:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875145.583343:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583350:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583373:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875145.583376:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875145.583381:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583396:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583409:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583414:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583419:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583423:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875145.583426:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583432:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583439:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875145.583441:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875145.583444:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583450:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583508:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e1c expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583521:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e1c expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.583528:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875145.583530:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788875145.583533:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35c00, rc 0) 00000100:00100000:1.0:1788875145.583604:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11570:x1875771218021376:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1103us (1289us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788875145.583613:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 195 00000100:00100000:0.0:1788875145.587476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.587572:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218021504 00000100:00100000:2.0:1788875145.587581:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218021504 00000100:00100000:2.0:1788875145.587642:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 196 00000100:00100000:2.0:1788875145.587653:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11570:x1875771218021504:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1788875145.587721:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.587739:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.587748:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.587825:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.587852:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 34 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.587865:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241082368:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875145.587949:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03243a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788875145.591920:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241082368:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875145.591952:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.593189:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.593489:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218021760 00000100:00100000:2.0:1788875145.593498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218021760 00000100:00100000:2.0:1788875145.593549:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1788875145.593560:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:5590:x1875771218021760:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788875145.593938:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:5590:x1875771218021760:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 380us (762us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788875145.593946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:3.0:1788875145.596726:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.597114:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218021888 00000100:00100000:2.0:1788875145.597125:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218021888 00010000:00010000:2.0:1788875145.597167:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 36 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875145.597319:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 75 00000100:00100000:2.0:1788875145.597329:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05655450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:2348:x1875771218021888:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875145.597348:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875145.597367:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 36 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597380:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 36 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597412:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e07 expref: 36 pid: 5842 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597428:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:2.0:1788875145.597434:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597443:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597450:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.597481:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875145.597546:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05655450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:2348:x1875771218021888:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 219us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875145.597553:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 75 00010000:00010000:3.0:1788875145.597643:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597651:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597690:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597709:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597715:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597720:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875145.597725:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597733:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597742:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:3.0:1788875145.597745:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875145.597748:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.597754:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875145.597841:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11570:x1875771218021504:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 10190us (10374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875145.597849:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 196 00000100:00100000:0.0:1788875145.602867:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.602963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218022144 00000100:00100000:2.0:1788875145.602975:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218022144 00000100:00100000:2.0:1788875145.603035:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875145.603046:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+34:11570:x1875771218022144:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875145.603327:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:11570:x1875771218022144:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 283us (471us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788875145.603351:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:0.0:1788875145.726221:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.729593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218022400 00000100:00100000:2.0:1788875145.729611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218022400 00000100:00100000:2.0:1788875145.729696:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:2.0:1788875145.729708:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+35:11581:x1875771218022400:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:2.0:1788875145.729734:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875145.729756:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e23 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729858:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729872:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729885:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729901:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729908:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.729914:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730177:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730197:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730204:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875145.730214:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788875145.730306:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730312:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730319:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730325:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.730330:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730337:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730348:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875145.730351:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.730355:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730361:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d82f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730373:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730417:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730423:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730440:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.730443:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730450:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730459:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875145.730461:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875145.730464:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d82f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730511:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d82f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e23 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730524:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e23 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.730531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:2.0:1788875145.730533:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875145.730542:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875145.730620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11581:x1875771218022400:12345-192.168.202.7@tcp:101:cat.0 Request processed in 914us (4408us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788875145.730628:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 197 00000100:00100000:0.0:1788875145.740485:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.740751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218022656 00000100:00100000:2.0:1788875145.740762:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218022656 00000100:00100000:2.0:1788875145.740856:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:2.0:1788875145.740866:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11581:x1875771218022656:12345-192.168.202.7@tcp:35:cat.0 00000100:00100000:2.0:1788875145.741107:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:11581:x1875771218022656:12345-192.168.202.7@tcp:35:cat.0 Request processed in 242us (631us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788875145.741114:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 54 00000100:00100000:0.0:1788875145.775090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.775199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218022912 00000100:00100000:1.0:1788875145.775208:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218022912 00000100:00100000:1.0:1788875145.775268:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 198 00000100:00100000:1.0:1788875145.775278:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:11582:x1875771218022912:12345-192.168.202.7@tcp:36:rm.0 00010000:00010000:1.0:1788875145.775335:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788875145.775362:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d82f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e23 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775391:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35c00/0x60858e6020d82f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e1c expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775405:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e0e expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a045bae00) 00010000:00010000:1.0:1788875145.775446:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875145.775467:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775480:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775490:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775517:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775525:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775532:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775829:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775838:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.775845:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788875145.776393:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788875145.776404:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360641630748ns, next at 361641628197ns, rc = 0 00010000:00010000:1.0:1788875145.776465:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776475:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776482:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776489:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776495:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776501:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776524:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875145.776542:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776549:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776555:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.776559:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875145.776561:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875145.776565:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776566:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.776572:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875145.776574:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.776575:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.776581:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.776589:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10bf8900) 00010000:00010000:1.0:1788875145.776591:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788875145.777359:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e5a10bf8900) 00010000:00010000:2.0:1788875145.777364:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788875145.777369:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.777442:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d82fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875145.777477:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875145.777479:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875145.777481:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875145.779342:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.779359:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82f99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781262:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781277:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781283:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781287:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875145.781290:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781296:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781309:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875145.781311:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875145.781315:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.781319:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82f8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788875145.781348:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af01d837 reply state 00000000c9fe4209 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875145.781355:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875145.781465:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+37:11582:x1875771218022912:12345-192.168.202.7@tcp:36:rm.0 Request processed in 6185us (6382us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788875145.781473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 198 00010000:00010000:1.0:1788875145.786407:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786425:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786433:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786439:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875145.786444:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786453:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786470:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875145.786473:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875145.786477:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.786484:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d82f92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.862311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875145.862805:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023168 00000100:00100000:3.0:1788875145.862816:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023168 00000100:00100000:3.0:1788875145.862877:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 199 00000100:00100000:3.0:1788875145.862887:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+36:11588:x1875771218023168:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875145.862911:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875145.862943:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82fa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e2a expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863058:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863084:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863097:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863113:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863120:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.863126:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875145.864217:0:11390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788875145.864416:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864428:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864439:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864474:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864494:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864502:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864508:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875145.864513:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864521:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864533:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875145.864536:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875145.864541:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864546:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d82fae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875145.864561:0:11390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053d856e1 reply state 000000009171e137 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875145.864569:0:11390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788875145.864602:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d82fa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 39 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864617:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 38 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.864635:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:3.0:1788875145.864638:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875145.864641:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788875145.864727:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:11588:x1875771218023168:12345-192.168.202.7@tcp:101:bash.0 Request processed in 1841us (2427us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788875145.864735:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 199 00010000:00010000:3.0:1788875145.873626:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873644:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873653:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873660:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875145.873664:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873672:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873689:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10903c00) 00010000:00010000:3.0:1788875145.873693:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875145.873698:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.873705:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d82fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875145.873950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875145.874413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023296 00000100:00100000:3.0:1788875145.874423:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023296 00000100:00100000:3.0:1788875145.874498:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:3.0:1788875145.874509:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2347:x1875771218023296:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875145.874525:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875145.874542:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e31 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875145.874566:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788875145.874585:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788875145.874589:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875145.874598:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.874615:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.874627:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875145.874679:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218023296:12345-192.168.202.7@tcp:101:bash.0 Request processed in 172us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875145.874687:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00080000:2.0:1788875145.874756:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875145.878358:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.878463:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023424 00000100:00100000:1.0:1788875145.878472:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023424 00000100:00100000:1.0:1788875145.878528:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:1.0:1788875145.878538:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:11588:x1875771218023424:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:1.0:1788875145.878557:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875145.878576:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e38 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.878605:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.878613:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875145.878618:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875145.878623:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.878661:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.878675:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875145.878691:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241082496:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875145.878816:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d27c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875145.885046:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875145.885647:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875771241082496:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875145.885702:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875145.885725:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35e00, rc 0) 00000100:00100000:1.0:1788875145.885810:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:11588:x1875771218023424:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7273us (7462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875145.885820:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1788875145.892423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023552 00000100:00100000:3.0:1788875145.892438:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023552 00010000:00010000:3.0:1788875145.892486:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875145.892557:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:3.0:1788875145.892568:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771218023552:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875145.892585:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875145.892607:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.892622:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.892646:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d82fca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e31 expref: 7 pid: 6697 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.892664:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875145.892668:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875145.892678:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.892689:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875145.892729:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875145.892745:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241082624:192.168.202.7@tcp:105: 00000100:00100000:3.0:1788875145.892897:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22480 going to sleep for 11 seconds 00000100:00100000:3.0:1788875145.899360:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5827:1875771241082624:192.168.202.7@tcp:105: 00010000:00010000:3.0:1788875145.899399:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875145.899462:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2347:x1875771218023552:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 6895us (14427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875145.899473:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 76 00000100:00100000:0.0:1788875145.904428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875145.904557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023808 00000100:00100000:2.0:1788875145.904569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023808 00000100:00100000:2.0:1788875145.904628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 55 00000100:00100000:2.0:1788875145.904638:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+38:11588:x1875771218023808:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:2.0:1788875145.905074:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:11588:x1875771218023808:12345-192.168.202.7@tcp:35:bash.0 Request processed in 429us (647us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788875145.905090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 55 00010000:00010000:2.0:1788875145.998126:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875146.081537:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.081643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218023936 00000100:00100000:1.0:1788875146.081655:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218023936 00000100:00100000:1.0:1788875146.081728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 200 00000100:00100000:1.0:1788875146.081739:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+39:11604:x1875771218023936:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875146.081762:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875146.081810:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.081878:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.081894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.081905:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875146.081939:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788875146.081943:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875146.081959:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.082005:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e3f expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.082024:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e3f expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.082033:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875146.082036:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788875146.082041:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35800, rc 0) 00000100:00100000:1.0:1788875146.082525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11604:x1875771218023936:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 785us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.082533:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 200 00000100:00100000:0.0:1788875146.087723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.088035:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024192 00000100:00100000:1.0:1788875146.088046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024192 00000100:00100000:1.0:1788875146.088214:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:1.0:1788875146.088226:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+40:11604:x1875771218024192:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875146.088248:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875146.088269:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e46 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.088366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.088388:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.088400:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875146.088425:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788875146.088558:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d82fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e46 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.088575:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e46 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.088584:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:1.0:1788875146.088586:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875146.088590:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34800, rc 0) 00000100:00100000:1.0:1788875146.088677:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+42:11604:x1875771218024192:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 452us (964us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788875146.088683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 201 00000100:00100000:0.0:1788875146.092993:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.093041:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.093171:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024448 00000100:00100000:3.0:1788875146.093244:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024448 00000100:00100000:3.0:1788875146.093307:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00100000:3.0:1788875146.093317:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+42:11604:x1875771218024448:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875146.093341:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875146.093361:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ffb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e4d expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.093462:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.093478:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.093490:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875146.093503:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788875146.093628:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d82ffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e4d expref: 45 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.093647:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e4d expref: 44 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.093830:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:3.0:1788875146.093833:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788875146.093837:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875146.093901:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:11604:x1875771218024448:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 584us (917us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788875146.093907:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 202 00000100:00100000:2.0:1788875146.094688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024576 00000100:00100000:2.0:1788875146.094698:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024576 00000100:00100000:2.0:1788875146.094751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1788875146.094761:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+44:2350:x1875771218024576:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875146.094800:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875146.094822:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d82fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e46 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.094835:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:2.0:1788875146.094839:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875146.094867:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:2350:x1875771218024576:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 109us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.094874:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:0.0:1788875146.102975:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.103343:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024704 00000100:00100000:3.0:1788875146.103354:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024704 00000100:00100000:3.0:1788875146.103424:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:3.0:1788875146.103435:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+6:2348:x1875771218024704:12345-192.168.202.7@tcp:1:lfs.0 00010000:00010000:3.0:1788875146.103479:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.103500:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.103508:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875146.103513:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.103518:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.103558:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.103573:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 6 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.103604:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241082752:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875146.103713:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22480 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.105952:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875771241082752:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875146.105981:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.107984:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.108082:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024832 00000100:00100000:2.0:1788875146.108093:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024832 00002000:00100000:2.0:1788875146.108155:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e5a3cd88700 x1875771218024832/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:52/0 lens 504/0 e 0 to 0 dl 1788875157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875146.108166:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3cd88700 with x1875771218024832 ext(0->8) 00010000:00010000:2.0:1788875146.108186:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 7 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.108203:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 7 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875146.108211:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3cd88700 00000100:00100000:2.0:1788875146.108245:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1788875146.108257:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218024832:12345-192.168.202.7@tcp:4:lfs.0 00000100:00100000:2.0:1788875146.109064:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771218024832:12345-192.168.202.7@tcp:4:lfs.0 Request processed in 806us (1086us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788875146.109074:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00002000:00100000:2.0:1788875146.109081:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e5a3cd88700 x1875771218024832/t4294967308(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:52/0 lens 504/448 e 0 to 0 dl 1788875157 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875146.109089:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3cd88700 with x1875771218024832 ext(0->8) 00010000:00010000:2.0:1788875146.109097:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.109115:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875146.109122:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5a3cd88700 00000100:00100000:3.0:1788875146.112582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.112828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218024960 00000100:00100000:2.0:1788875146.112838:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218024960 00010000:00010000:2.0:1788875146.112880:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.112963:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:2.0:1788875146.112973:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2348:x1875771218024960:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875146.112989:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788875146.113009:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788875146.113012:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788875146 00002000:00010000:2.0:1788875146.113015:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788875146 00002000:00010000:2.0:1788875146.113017:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788875146 00010000:00010000:2.0:1788875146.113023:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.113037:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.113070:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f75bc500/0x60858e6020d82fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e38 expref: 9 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.113111:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875146.113115:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875146.113122:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.113131:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.113179:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875146.113244:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218024960:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 272us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.113251:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00010000:00010000:0.0:1788875146.113536:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113546:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113572:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113580:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113595:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113602:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875146.113605:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113614:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113627:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.113635:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c252e3/0x60858e6020d83010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.113712:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218024704:12345-192.168.202.7@tcp:1:lfs.0 Request processed in 10279us (10749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.113720:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:0.0:1788875146.117028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.117162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218025216 00000100:00100000:2.0:1788875146.117231:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218025216 00000100:00100000:2.0:1788875146.117324:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 56 00000100:00100000:2.0:1788875146.117335:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+43:11604:x1875771218025216:12345-192.168.202.7@tcp:35:lfs.0 00000004:00010000:2.0:1788875146.117407:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e4d expref: 43 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875146.117648:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788875146.117711:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788875146.118441:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788875146.118499:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.118516:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 47 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.118537:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.118573:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 47 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.118586:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 47 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.118600:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875771241082880:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.118750:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875146.122484:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.123342:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875771241082880:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875146.123374:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.123504:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218025344 00000100:00100000:3.0:1788875146.123511:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218025344 00010000:00010000:3.0:1788875146.123546:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 48 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.123616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:3.0:1788875146.123626:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+48:2348:x1875771218025344:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875146.123640:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.123647:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 48 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123673:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 48 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123696:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d82fbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e2a expref: 48 pid: 11390 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123710:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:3.0:1788875146.123714:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123724:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123744:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.123786:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875146.123848:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+47:2348:x1875771218025344:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 223us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.123855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00010000:00010000:0.0:1788875146.123911:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.123918:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788875146.124048:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788875146.124261:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788875146.124365:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241083008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788875146.124426:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875146.124454:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a36171540 going to sleep for 11 seconds 00000100:00100000:3.0:1788875146.125965:0:11970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241083008 00000100:00100000:3.0:1788875146.125976:0:11970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241083008 00000100:00100000:3.0:1788875146.126164:0:11970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788875146.126183:0:11970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241083008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788875146.126294:0:11970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241083008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.126301:0:11970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788875146.126404:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788875146.126410:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788875146.126433:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a34ee3100, transno 4294967307 00000100:00100000:1.0:1788875146.126453:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241083008:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788875146.126982:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788875146.127056:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241083136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788875146.127111:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875146.127143:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241083136 00000100:00100000:1.0:1788875146.127148:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241083136 00000100:00100000:1.0:1788875146.127175:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788875146.127182:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875771241083136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788875146.127329:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875771241083136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (217us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788875146.127336:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788875146.127363:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3d27c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788875146.127391:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d049180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875771241083136:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788875146.127435:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788875146.127469:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127479:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127487:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127493:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.127498:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127505:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:1.0:1788875146.127526:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788875146.127530:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.127538:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d83017 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875146.127702:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788875146.127839:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788875146.127851:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360993078133ns, next at 361993075980ns, rc = 0 00000001:00080000:1.0:1788875146.127858:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788875146.127887:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a10903900) 00010000:00010000:1.0:1788875146.127891:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788875146.127897:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14600/0x60858e6020d83002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e4d expref: 51 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.127997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:11604:x1875771218025216:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 10663us (10979us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788875146.128005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 56 00000020:00080000:1.0:1788875146.128008:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788875146.131443:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.131572:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218025472 00000100:00100000:2.0:1788875146.131581:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218025472 00000100:00100000:2.0:1788875146.131632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00100000:2.0:1788875146.131640:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+50:11604:x1875771218025472:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875146.131663:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.131684:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8301e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e54 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.131747:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8301e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e54 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.131809:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8301e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e54 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.131831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.131834:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875146.131838:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:2.0:1788875146.131895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:11604:x1875771218025472:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 255us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.131902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 203 00000100:00080000:0.0:1788875146.133817:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875146.135576:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.135662:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218025728 00000100:00100000:3.0:1788875146.135734:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218025728 00000100:00100000:3.0:1788875146.135958:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:3.0:1788875146.135970:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+51:11604:x1875771218025728:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875146.136333:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11604:x1875771218025728:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 365us (765us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788875146.136342:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 57 00000100:00100000:2.0:1788875146.230915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.231022:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218025856 00000100:00100000:0.0:1788875146.231034:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218025856 00000100:00100000:0.0:1788875146.231102:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 204 00000100:00100000:0.0:1788875146.231114:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11614:x1875771218025856:12345-192.168.202.7@tcp:34:lfs.0 00010000:00010000:0.0:1788875146.231202:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231221:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231236:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231251:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231258:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231265:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231361:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231415:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231423:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875146.231466:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231479:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231486:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231493:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231499:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.231504:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231513:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231524:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875146.231527:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.231531:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231537:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0000/0x60858e6020d83025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231559:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231565:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231571:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231576:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.231579:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231585:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231593:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875146.231595:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.231598:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231604:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8302c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231618:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231624:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231630:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231641:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.231644:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231650:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231658:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.231661:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.231664:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.231669:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.231750:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11614:x1875771218025856:12345-192.168.202.7@tcp:34:lfs.0 Request processed in 638us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.231758:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 204 00000100:00100000:0.0:1788875146.270725:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.270821:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218026112 00000100:00100000:1.0:1788875146.270831:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218026112 00000100:00100000:1.0:1788875146.270897:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00100000:1.0:1788875146.270908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+52:11617:x1875771218026112:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:1.0:1788875146.270933:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875146.270955:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d8303a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e5b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271030:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271044:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271055:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271100:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271107:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271113:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271247:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271256:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271264:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875146.271274:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788875146.271370:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271387:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271394:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271399:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.271403:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271422:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875146.271438:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875146.271443:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271449:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271462:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271467:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271473:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271477:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.271479:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271484:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271491:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875146.271493:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875146.271495:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271511:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35e00/0x60858e6020d83048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35a00/0x60858e6020d8303a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271569:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.271575:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875146.271577:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875146.271579:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34200, rc 0) 00000100:00100000:1.0:1788875146.271907:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:11617:x1875771218026112:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 999us (1191us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788875146.271915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 205 00000100:00100000:1.0:1788875146.276676:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.276759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218026240 00000100:00100000:2.0:1788875146.276788:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218026240 00000100:00100000:2.0:1788875146.276848:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:2.0:1788875146.276858:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:11617:x1875771218026240:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:2.0:1788875146.276926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.276943:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.276955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.276981:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.276987:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.277011:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.277017:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875146.277021:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.277028:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.277041:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.277044:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875146.277049:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.277056:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8305d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.277141:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:11617:x1875771218026240:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 285us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.277148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 206 00000100:00100000:3.0:1788875146.279748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.280080:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218026496 00000100:00100000:1.0:1788875146.280091:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218026496 00000100:00100000:1.0:1788875146.280145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:1.0:1788875146.280155:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+54:11617:x1875771218026496:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:1.0:1788875146.280417:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11617:x1875771218026496:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 262us (677us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788875146.280425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 58 00000100:00100000:3.0:1788875146.361367:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.361524:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218026752 00000100:00100000:2.0:1788875146.361534:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218026752 00000100:00100000:2.0:1788875146.361598:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:2.0:1788875146.361609:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11627:x1875771218026752:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:2.0:1788875146.361634:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.361637:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788875146.361676:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35800/0x60858e6020d82fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e3f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361718:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875146.361723:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875146.361739:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d83064 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e62 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361880:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361893:0:11390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361901:0:11390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361932:0:11390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.361945:0:11390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 55 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.361959:0:11390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241083264:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.362366:0:11390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788875146.365859:0:11390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11390:1875771241083264:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875146.365894:0:11390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.367435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.367534:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218026880 00000100:00100000:1.0:1788875146.367542:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218026880 00010000:00010000:1.0:1788875146.367583:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 56 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.367637:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:1.0:1788875146.367647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+56:2348:x1875771218026880:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875146.367674:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875146.367682:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 56 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367694:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 56 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367717:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d8304f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e5b expref: 56 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367734:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875146.367740:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367749:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367756:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.367825:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875146.367872:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:2348:x1875771218026880:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 226us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.367880:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00010000:00010000:0.0:1788875146.368480:0:11390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.368490:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875146.368509:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788875146.368676:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d83064 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 56 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.368693:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 55 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.368709:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.368712:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788875146.368715:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:0.0:1788875146.368761:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11627:x1875771218026752:12345-192.168.202.7@tcp:101:bash.0 Request processed in 7154us (7405us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788875146.368768:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 207 00000100:00100000:3.0:1788875146.372723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.372816:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027136 00000100:00100000:1.0:1788875146.372840:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027136 00000100:00100000:1.0:1788875146.372899:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 208 00000100:00100000:1.0:1788875146.372909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+55:11627:x1875771218027136:12345-192.168.202.7@tcp:36:bash.0 00010000:00010000:1.0:1788875146.373197:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.373215:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.373226:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788875146.373281:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788875146.373307:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007eaffc0c reply state 00000000401c3b75 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.373316:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875146.373412:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11627:x1875771218027136:12345-192.168.202.7@tcp:36:bash.0 Request processed in 504us (699us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788875146.373420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 208 00000020:00080000:1.0:1788875146.373425:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788875146.376431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.376507:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027264 00000100:00100000:0.0:1788875146.376519:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027264 00000100:00100000:0.0:1788875146.376584:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 209 00000100:00100000:0.0:1788875146.376596:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11627:x1875771218027264:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875146.376618:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.376639:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e69 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376721:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376736:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376744:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376752:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376801:0:8216:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376842:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.376855:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.376868:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241083392:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875146.376950:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a36171540 going to sleep for 11 seconds 00010000:00010000:1.0:1788875146.377651:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377663:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377670:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377675:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.377679:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377706:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377722:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875146.377724:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875146.377727:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377736:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.377743:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34200/0x60858e6020d83079 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.380994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.381088:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027392 00000100:00100000:2.0:1788875146.381098:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027392 00010000:00010000:2.0:1788875146.381138:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.381209:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:2.0:1788875146.381218:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:2347:x1875771218027392:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875146.381233:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875146.381240:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.381252:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 59 pid: 11390 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.381275:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.381281:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.381291:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.381298:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.381317:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875146.381375:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:2347:x1875771218027392:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 158us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.381391:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00010000:00010000:3.0:1788875146.382386:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d8306b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e62 expref: 58 pid: 11390 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.382406:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241083392:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875146.382429:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.382439:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.382445:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875146.382494:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788875146.382499:0:8216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875146.382520:0:8216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.382552:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 58 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.382566:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 57 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.382573:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875146.382576:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875146.382591:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:3.0:1788875146.382640:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11627:x1875771218027264:12345-192.168.202.7@tcp:101:bash.0 Request processed in 6047us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.382647:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 209 00000100:00100000:0.0:1788875146.386350:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.386464:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027648 00000100:00100000:1.0:1788875146.386475:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027648 00000100:00100000:1.0:1788875146.386540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:1.0:1788875146.386550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+57:11627:x1875771218027648:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:1.0:1788875146.386822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11627:x1875771218027648:12345-192.168.202.7@tcp:35:bash.0 Request processed in 273us (481us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788875146.386830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 59 00000100:00100000:0.0:1788875146.463080:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.463169:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027776 00000100:00100000:3.0:1788875146.463181:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027776 00000100:00100000:3.0:1788875146.463254:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:3.0:1788875146.463264:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+58:11633:x1875771218027776:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875146.463288:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875146.463311:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8308e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e70 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463416:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463433:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463447:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875146.463486:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788875146.463489:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875146.463507:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463530:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8308e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e70 expref: 60 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463548:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e70 expref: 59 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.463571:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875146.463573:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875146.463577:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875146.463640:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218027776:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 377us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.463647:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 210 00000100:00100000:2.0:1788875146.469696:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.469810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218027904 00000100:00100000:0.0:1788875146.469822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218027904 00000100:00100000:0.0:1788875146.469887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:0.0:1788875146.469897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218027904:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875146.469916:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.469940:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d8309c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470021:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470037:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470051:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470097:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470113:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470215:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470224:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875146.470272:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788875146.470277:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875146.470296:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470311:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470319:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470326:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470346:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470352:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.470356:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470363:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470375:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875146.470388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.470393:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470400:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470414:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470420:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470427:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470432:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.470435:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470451:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470459:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875146.470462:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.470465:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470503:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d8309c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e77 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470515:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e77 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.470523:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.470524:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875146.470527:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0c00, rc 0) 00000100:00100000:0.0:1788875146.470602:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11633:x1875771218027904:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 707us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.470609:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 211 00000100:00100000:0.0:1788875146.475257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.475383:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028160 00000100:00100000:3.0:1788875146.475393:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028160 00000100:00100000:3.0:1788875146.475455:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:3.0:1788875146.475466:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11633:x1875771218028160:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875146.475488:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875146.475510:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d830b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e7e expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.475620:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.475635:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 61 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.475642:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e77 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.475650:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.478072:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.478667:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028288 00000100:00100000:3.0:1788875146.478696:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028288 00010000:00010000:3.0:1788875146.478739:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e77 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.478819:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:3.0:1788875146.478830:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05657050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:2347:x1875771218028288:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875146.478846:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.478869:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875146.478876:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.478885:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.478892:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875146.478949:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05657050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:2347:x1875771218028288:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 121us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.478956:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00010000:00010000:2.0:1788875146.480593:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e77 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.480639:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 60 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.480654:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 60 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.480872:0:8216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241083648:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.480977:0:8216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.483636:0:8216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8216:1875771241083648:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875146.483680:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.485762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.485874:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028416 00000100:00100000:2.0:1788875146.485882:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028416 00010000:00010000:2.0:1788875146.485917:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 61 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.485944:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:2.0:1788875146.485952:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:2347:x1875771218028416:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875146.485967:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875146.485974:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 61 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.485986:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 61 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.486025:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e69 expref: 61 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.486039:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.486044:0:8459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.486054:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.486067:0:8459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.486102:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875146.486158:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:2347:x1875771218028416:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 205us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.486174:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00010000:00010000:3.0:1788875146.486273:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.486282:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875146.486301:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788875146.486460:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d830b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 61 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.486475:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 60 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.486494:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875146.486497:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875146.486499:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788875146.486524:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11633:x1875771218028160:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 11060us (11279us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788875146.486531:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 212 00000100:00100000:1.0:1788875146.490649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.490744:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028672 00000100:00100000:3.0:1788875146.490755:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028672 00000100:00100000:3.0:1788875146.490864:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:3.0:1788875146.490874:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11633:x1875771218028672:12345-192.168.202.7@tcp:103:lfs.0 00010000:00010000:3.0:1788875146.490893:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.490919:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8301e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e54 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.490936:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875146.490942:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875146.490997:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218028672:12345-192.168.202.7@tcp:103:lfs.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.491004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:1.0:1788875146.497195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.497304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028800 00000100:00100000:0.0:1788875146.497315:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028800 00000100:00100000:0.0:1788875146.497390:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:0.0:1788875146.497401:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218028800:12345-192.168.202.7@tcp:58:lfs.0 00010000:00010000:0.0:1788875146.497543:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.497561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.497572:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875146.497992:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788875146.498082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218028800:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 683us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.498089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 213 00000100:00100000:1.0:1788875146.501561:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.501668:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218028928 00000100:00100000:2.0:1788875146.501677:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218028928 00000100:00100000:2.0:1788875146.501738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 214 00000100:00100000:2.0:1788875146.501749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+59:11633:x1875771218028928:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875146.501806:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.501831:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e85 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501892:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501922:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501944:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501957:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501972:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.501975:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875146.501979:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.501986:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18200, rc 0) 00000100:00100000:2.0:1788875146.502044:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11633:x1875771218028928:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 297us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.502052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 214 00000040:00080000:3.0:1788875146.510037:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788875146.510049:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875146.510134:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788875146.510141:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788875146.510286:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241083776:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788875146.510408:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875146.524062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.524197:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35259500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241083776:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788875146.524372:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218029056 00000100:00100000:2.0:1788875146.524390:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218029056 00000100:00100000:2.0:1788875146.524450:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:2.0:1788875146.524458:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11634:x1875771218029056:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788875146.524489:0:8216:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788875146.524588:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11634:x1875771218029056:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 129us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.524596:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 215 00000100:00100000:1.0:1788875146.532461:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.532584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218029184 00000100:00100000:0.0:1788875146.532594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218029184 00000100:00100000:0.0:1788875146.532670:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:0.0:1788875146.532682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11634:x1875771218029184:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.532811:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532829:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532842:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532879:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532906:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532915:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532922:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875146.532962:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788875146.532967:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875146.532979:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532989:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.532995:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533001:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533006:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.533010:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533016:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533035:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:0.0:1788875146.533037:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.533043:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533050:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d830db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533062:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533068:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533074:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533078:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.533081:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533087:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533094:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875146.533097:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.533099:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533105:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d830e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533131:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533137:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533143:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533148:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.533150:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533155:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533162:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.533164:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.533167:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.533172:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d830e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.533239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11634:x1875771218029184:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 559us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.533246:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 216 00000100:00100000:1.0:1788875146.537212:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.537299:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218029440 00000100:00100000:0.0:1788875146.537310:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218029440 00000100:00100000:0.0:1788875146.537370:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:0.0:1788875146.537401:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+60:11634:x1875771218029440:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.537423:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.537447:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e8c expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.537692:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.537709:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.537721:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875146.537733:0:11390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788875146.538351:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538360:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538366:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538371:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.538385:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538393:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538405:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.538415:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788875146.538420:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538427:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d830f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538476:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e8c expref: 62 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538488:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:0.0:1788875146.538490:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875146.538494:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d830f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e8c expref: 62 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.538504:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0c00, rc 0) 00000100:00100000:0.0:1788875146.538651:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218029440:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1251us (1570us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788875146.538660:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 217 00000100:00100000:3.0:1788875146.543543:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.543660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218029568 00000100:00100000:2.0:1788875146.543671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218029568 00000100:00100000:2.0:1788875146.543737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:2.0:1788875146.543747:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218029568:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788875146.543815:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788875146.543949:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218029568:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 202us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.543957:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 218 00000100:00100000:1.0:1788875146.547931:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.548229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218029824 00000100:00100000:2.0:1788875146.548241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218029824 00000100:00100000:2.0:1788875146.548312:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:2.0:1788875146.548323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218029824:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875146.548344:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.548348:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788875146.548396:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d83095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e70 expref: 61 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.548418:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:2.0:1788875146.548425:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875146.548442:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d83105 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e93 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788875146.551213:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788875146.551469:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8310c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.551490:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.551524:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8310c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.552843:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d83105 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e93 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.552871:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8310c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e93 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.552882:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a045ba300) 00010000:00010000:2.0:1788875146.552886:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788875146.552890:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19600, rc 0) 00000100:00100000:2.0:1788875146.553408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:11634:x1875771218029824:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5084us (5484us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788875146.553418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 219 00000100:00100000:3.0:1788875146.567495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.568065:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030080 00000100:00100000:0.0:1788875146.568077:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030080 00000100:00100000:0.0:1788875146.568155:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:0.0:1788875146.568164:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:11634:x1875771218030080:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.568223:0:11390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875146.568251:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8310c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e93 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568270:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a045ba300) 00010000:00010000:0.0:1788875146.568295:0:11390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875146.568317:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568330:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568340:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568355:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568361:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568367:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568441:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568448:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568454:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568460:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.568464:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568471:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568487:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:0.0:1788875146.568489:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.568494:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568499:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8311a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568509:0:11390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568515:0:11390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568520:0:11390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568525:0:11390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.568528:0:11390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568544:0:11390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568552:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdd754707 (ffff9e5a0bc0d800) 00010000:00010000:0.0:1788875146.568555:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.568558:0:11390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.568563:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdd754707 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.568674:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218030080:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 510us (1190us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788875146.568681:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 220 00000100:00100000:1.0:1788875146.574685:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875146.574711:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241083904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875146.574829:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875146.574837:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.574907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030208 00000100:00100000:0.0:1788875146.574913:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241083904 00000100:00100000:1.0:1788875146.574915:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030208 00000100:00100000:0.0:1788875146.574918:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241083904 00000100:00100000:0.0:1788875146.574963:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788875146.574973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:0.0:1788875146.574973:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241083904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875146.574988:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+61:11634:x1875771218030208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875146.575004:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00000024:0.0:1788875146.575016:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1788875146.575029:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d83128 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.575056:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241083904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.575062:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788875146.575269:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241083904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788875146.575405:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788875146.576484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.576504:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.576516:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.576618:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34c00/0x60858e6020d83128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.576637:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.576647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875146.576655:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788875146.576659:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34800, rc 0) 00000100:00100000:1.0:1788875146.576733:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:11634:x1875771218030208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1749us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.576741:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 221 00000100:00100000:1.0:1788875146.581616:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.582388:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030464 00000100:00100000:3.0:1788875146.582400:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030464 00000100:00100000:3.0:1788875146.582465:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 222 00000100:00100000:3.0:1788875146.582475:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+62:11634:x1875771218030464:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788875146.582561:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.582578:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.582589:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875146.583064:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:3.0:1788875146.583394:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002418fe1 reply state 00000000100e0e4d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.583404:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788875146.583511:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+64:11634:x1875771218030464:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1035us (1903us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788875146.583519:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 222 00010000:00010000:0.0:1788875146.587764:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587814:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587822:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587827:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.587833:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587841:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587885:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:0.0:1788875146.587888:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788875146.587893:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.587899:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d83136 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.597825:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.598952:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030592 00000100:00100000:2.0:1788875146.598966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030592 00000100:00100000:2.0:1788875146.599082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:2.0:1788875146.599093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+63:11634:x1875771218030592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875146.599119:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.599143:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ea1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.599400:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.599416:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.599453:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:2.0:1788875146.599456:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875146.599460:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18a00, rc 0) 00000100:00100000:2.0:1788875146.599534:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+64:11634:x1875771218030592:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 442us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.599542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 223 00000100:00100000:3.0:1788875146.605025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.605454:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030720 00000100:00100000:0.0:1788875146.605464:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030720 00000100:00100000:0.0:1788875146.605509:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:0.0:1788875146.605517:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2347:x1875771218030720:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788875146.605823:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0476e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2347:x1875771218030720:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 306us (807us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788875146.605831:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:1.0:1788875146.615576:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.615662:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218030976 00000100:00100000:3.0:1788875146.615672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218030976 00000100:00100000:3.0:1788875146.615754:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1788875146.615767:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+64:11634:x1875771218030976:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788875146.616047:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+65:11634:x1875771218030976:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 282us (479us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788875146.616056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 60 00000100:00100000:3.0:1788875146.621930:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.622000:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218031232 00000100:00100000:1.0:1788875146.622011:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218031232 00000100:00100000:1.0:1788875146.622123:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 224 00000100:00100000:1.0:1788875146.622136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+65:11634:x1875771218031232:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788875146.622280:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+65:11634:x1875771218031232:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 147us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.622289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 224 00000100:00100000:1.0:1788875146.625399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.625530:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218031360 00000100:00100000:0.0:1788875146.625969:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218031360 00000100:00100000:0.0:1788875146.626064:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:0.0:1788875146.626073:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+65:11634:x1875771218031360:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.626096:0:11390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.626118:0:11390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ea8 expref: -99 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626183:0:11390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626200:0:11390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626231:0:11390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875146.626275:0:11390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875146.626300:0:11390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626329:0:11390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1600/0x60858e6020d83144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea8 expref: 67 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626346:0:11390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea8 expref: 66 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.626356:0:11390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:0.0:1788875146.626358:0:11390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788875146.626362:0:11390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0c00, rc 0) 00000100:00100000:0.0:1788875146.626484:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+66:11634:x1875771218031360:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 410us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.626491:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 225 00000100:00100000:2.0:1788875146.634420:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.634506:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218031488 00000100:00100000:0.0:1788875146.634517:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218031488 00000100:00100000:0.0:1788875146.634572:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:0.0:1788875146.634582:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+10:2347:x1875771218031488:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.634601:0:6901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.634635:0:6901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0eaf expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875146.634686:0:6901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0118b, blocks: 0x1 00010000:00010000:0.0:1788875146.634706:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788875146.634711:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875146.634721:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 11 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.634744:0:6901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 11 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.634757:0:6901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:0.0:1788875146.634837:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2347:x1875771218031488:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 257us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.634844:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:1.0:1788875146.640276:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.640709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218031744 00000100:00100000:2.0:1788875146.640719:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218031744 00000100:00100000:2.0:1788875146.640805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 226 00000100:00100000:2.0:1788875146.640815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+66:11634:x1875771218031744:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788875146.640917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+66:11634:x1875771218031744:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 104us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.640925:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 226 00000100:00100000:1.0:1788875146.653296:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.653501:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218031872 00000100:00100000:0.0:1788875146.653511:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218031872 00000100:00100000:0.0:1788875146.653603:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:0.0:1788875146.653615:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:11634:x1875771218031872:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875146.653635:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875146.653655:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0eb6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.653690:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.653720:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875146.653724:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875146.653731:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.653768:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.653830:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.653844:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875771241084032:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875146.653959:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a36171b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788875146.657296:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875771241084032:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875146.657338:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.657370:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1600, rc 0) 00000100:00100000:0.0:1788875146.657480:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:11634:x1875771218031872:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 3866us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.657489:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875146.665406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.665693:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032000 00000100:00100000:2.0:1788875146.665704:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032000 00010000:00010000:2.0:1788875146.665746:0:8459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.665884:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:2.0:1788875146.665895:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:2348:x1875771218032000:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875146.665922:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875146.665945:0:8459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.665980:0:8459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.666005:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c058b07/0x60858e6020d83152 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eaf expref: 12 pid: 6901 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.666023:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875146.666028:0:8459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875146.666036:0:8459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.666046:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.666085:0:8459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.666098:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241084160:192.168.202.7@tcp:105: 00000100:00100000:2.0:1788875146.666173:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a4204d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.675048:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8459:1875771241084160:192.168.202.7@tcp:105: 00010000:00010000:2.0:1788875146.675085:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875146.675154:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2348:x1875771218032000:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 9260us (9757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.675166:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:3.0:1788875146.675451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.676014:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032128 00000100:00100000:2.0:1788875146.676022:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032128 00002000:00100000:2.0:1788875146.676082:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e5a355e7b80 x1875771218032128/t0(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:52/0 lens 504/0 e 0 to 0 dl 1788875157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875146.676092:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a355e7b80 with x1875771218032128 ext(0->12) 00002000:00010000:2.0:1788875146.676098:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a355e7b80 00000100:00100000:2.0:1788875146.676131:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1788875146.676142:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+11:2347:x1875771218032128:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788875146.676634:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2347:x1875771218032128:12345-192.168.202.7@tcp:4:lhsmtool_posix.0 Request processed in 491us (1182us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788875146.676642:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00002000:00100000:2.0:1788875146.676649:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e5a355e7b80 x1875771218032128/t4294967320(0) o4->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:52/0 lens 504/448 e 0 to 0 dl 1788875157 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788875146.676659:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a355e7b80 with x1875771218032128 ext(0->12) 00002000:00010000:2.0:1788875146.676662:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a355e7b80 00000100:00100000:1.0:1788875146.683161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.683733:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032256 00000100:00100000:2.0:1788875146.683744:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032256 00000100:00100000:2.0:1788875146.683846:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 227 00000100:00100000:2.0:1788875146.683857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+66:11634:x1875771218032256:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788875146.748074:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+66:11634:x1875771218032256:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 64196us (64899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.748089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 227 00000001:00080000:3.0:1788875146.748138:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:3.0:1788875146.748172:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a0626c780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788875146.748177:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a35ef7d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a0626c6c0 00000020:00080000:3.0:1788875146.748181:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a35ef7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a35e35800 00000004:00080000:3.0:1788875146.748220:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788875146.748237:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a3d27c180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788875146.748240:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a3cd22400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a3d27c3c0 00000020:00080000:3.0:1788875146.748242:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a3cd22200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a35e36400 00000004:00080000:3.0:1788875146.748248:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1788875146.748264:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:3.0:1788875146.748295:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788875146.748512:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788875146.748738:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788875146.749109:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241084416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788875146.749239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875146.749300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788875146.749319:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241084288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788875146.749418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875146.749455:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241084416 00000100:00100000:3.0:1788875146.749463:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241084416 00000100:00100000:3.0:1788875146.749504:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241084288 00000100:00100000:3.0:1788875146.749507:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241084288 00000100:00100000:3.0:1788875146.749529:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788875146.749603:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241084416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788875146.749768:0:6901:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788875146.749818:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.749915:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.749924:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788875146.749929:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.749934:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.749962:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.749976:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 12 pid: 6694 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.749989:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241084544:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875146.750047:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a06a22cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875146.750080:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788875146.750089:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875771241084288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788875146.750104:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788875146.750129:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0118a, atime: 0x6aa0118a, ctime: 0x6aa0118a, blocks: 0x1 00010000:00010000:3.0:1788875146.750135:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.750144:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788875146.750147:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875146.750152:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.755320:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241084544:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875146.755447:0:6901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.760203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1788875146.761087:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.761111:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.761119:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.761282:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1788875146.761334:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788875146.765497:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241084288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15398us (16141us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788875146.765512:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788875146.765570:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032384 00000100:00100000:3.0:1788875146.765590:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032384 00000100:00100000:3.0:1788875146.765743:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1788875146.765753:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2350:x1875771218032384:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788875146.765917:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032512 00000100:00100000:3.0:1788875146.765922:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032512 00010000:00010000:3.0:1788875146.765950:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 14 pid: 6694 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.765981:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1788875146.765988:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+14:2348:x1875771218032512:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875146.765999:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.766005:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 14 pid: 6694 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.766017:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 14 pid: 6694 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.766040:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d82f22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e15 expref: 14 pid: 6694 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.766523:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.766529:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.766953:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.766983:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.767014:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1788875146.767676:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a355e4a80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788875146.767689:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241084288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788875146.767890:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+13:2348:x1875771218032512:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 1835us (6542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.767900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00010000:00010000:3.0:1788875146.767978:0:6901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.767989:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.768000:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.768007:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.772575:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788875146.772591:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.772606:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875146.776454:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776482:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776507:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776515:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d83167 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776555:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875146.776561:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776569:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875146.776573:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776589:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776600:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.776609:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875146.776908:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875146.776912:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875146.782296:0:6901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788875146.782311:0:6901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d83160 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.783937:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875146.785230:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241084416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35622us (35983us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788875146.785255:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1788875146.785912:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a355e5f80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788875146.785933:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241084416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788875146.822894:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+12:2350:x1875771218032384:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 57065us (62625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.822910:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000001:00080000:0.0:1788875146.824493:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1788875146.824510:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1788875146.824522:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:1.0:1788875146.825859:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.825946:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032768 00000100:00100000:3.0:1788875146.825957:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032768 00000100:00100000:3.0:1788875146.826017:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 228 00000100:00100000:3.0:1788875146.826026:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11634:x1875771218032768:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788875146.826087:0:8216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.826111:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0c00/0x60858e6020d8314b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea8 expref: 20 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.826129:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:3.0:1788875146.826134:0:8216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788875146.826253:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.826269:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.826280:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788875146.826516:0:8216:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000256f84a5 reply state 00000000ef86cebb transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.826526:0:8216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788875146.826864:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:11634:x1875771218032768:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 837us (1011us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788875146.826884:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 228 00000100:00100000:1.0:1788875146.833304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.833413:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218032896 00000100:00100000:0.0:1788875146.833424:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218032896 00000100:00100000:0.0:1788875146.833488:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1788875146.833511:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c6e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2347:x1875771218032896:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788875146.834034:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788875146.834038:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788875146 00002000:00010000:0.0:1788875146.834040:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788875146 00002000:00010000:0.0:1788875146.834042:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788875147 -> 1788875146 00002000:00010000:0.0:1788875146.834044:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788875146.834224:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c6e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771218032896:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 665us (870us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788875146.834233:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00010000:00010000:3.0:1788875146.836682:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836701:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836710:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836715:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875146.836720:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836728:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836746:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:3.0:1788875146.836750:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875146.836755:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.836761:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15c00/0x60858e6020d8316e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.838210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.838359:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033152 00000100:00100000:2.0:1788875146.838369:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033152 00000100:00100000:2.0:1788875146.838440:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:2.0:1788875146.838450:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:11634:x1875771218033152:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788875146.838528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.838567:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.838576:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.838618:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.838633:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 20 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.838648:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241084672:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.838807:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.846407:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241084672:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875146.846439:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875146.849003:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.849275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033280 00000100:00100000:0.0:1788875146.849286:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033280 00010000:00010000:0.0:1788875146.849323:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 21 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.849371:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:0.0:1788875146.849389:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:2347:x1875771218033280:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875146.849405:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875146.849413:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 21 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849427:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 21 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849454:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34800/0x60858e6020d8312f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e9a expref: 21 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849472:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:0.0:1788875146.849478:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849486:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849492:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.849531:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875146.849578:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:2347:x1875771218033280:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 190us (586us total) trans 0 rc 0/0 00010000:00010000:1.0:1788875146.849925:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849932:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849957:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849961:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849965:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849969:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.849973:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849978:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:1.0:1788875146.849986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788875146.849989:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.849993:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d83175 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.850104:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:1.0:1788875146.850234:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11634:x1875771218033152:12345-192.168.202.7@tcp:55:lhsmtool_posix.0 Request processed in 11786us (12033us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788875146.850242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 229 00000100:00100000:1.0:1788875146.866546:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.866638:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033408 00000100:00100000:3.0:1788875146.866648:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033408 00000100:00100000:3.0:1788875146.866713:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:3.0:1788875146.866724:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2348:x1875771218033408:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788875146.866796:0:6901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.866832:0:6901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.866841:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875146.866846:0:6901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.866851:0:6901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.866941:0:6901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.866961:0:6901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 8 pid: 6696 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.866978:0:6901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241084800:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.867168:0:6901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.874924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.875116:0:6901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6901:1875771241084800:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875146.875156:0:6901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.875618:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033536 00000100:00100000:3.0:1788875146.875627:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033536 00010000:00010000:3.0:1788875146.875668:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 9 pid: 6696 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.875709:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:3.0:1788875146.875719:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+9:2347:x1875771218033536:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875146.875737:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.875764:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 9 pid: 6696 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.875808:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 9 pid: 6696 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.875831:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83159 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eb6 expref: 9 pid: 6696 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.875872:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.875877:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788875146.875884:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.875894:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.875928:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875146.875983:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2347:x1875771218033536:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 265us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.875991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 86 00010000:00010000:2.0:1788875146.877276:0:6901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877293:0:6901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877327:0:6901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877335:0:6901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877342:0:6901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877349:0:6901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875146.877354:0:6901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877362:0:6901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877387:0:6901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.877395:0:6901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c51835/0x60858e6020d8317c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.877498:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218033408:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 10773us (10961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875146.877507:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:2.0:1788875146.887758:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.887878:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033792 00000100:00100000:3.0:1788875146.887893:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033792 00000100:00100000:3.0:1788875146.887959:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 230 00000100:00100000:3.0:1788875146.887970:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11634:x1875771218033792:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788875146.888066:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888084:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888097:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888367:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888419:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888426:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888460:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.888474:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 20 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.888487:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241084928:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875146.888578:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197600 going to sleep for 11 seconds 00000100:00100000:3.0:1788875146.892721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.892857:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241084928:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875146.892886:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.893001:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218033920 00000100:00100000:0.0:1788875146.893009:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218033920 00010000:00010000:0.0:1788875146.893048:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 21 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.893094:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1788875146.893103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05655c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:2348:x1875771218033920:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875146.893119:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875146.893126:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 21 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893138:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 21 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893177:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d8313d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ea1 expref: 21 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893194:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:0.0:1788875146.893200:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893227:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893235:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.893263:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875146.893323:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05655c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:2348:x1875771218033920:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 220us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875146.893330:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00010000:00010000:3.0:1788875146.894094:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.894105:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788875146.895061:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788875146.895560:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788875146.895619:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788875146.895722:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875771241085056:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788875146.895812:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875146.896193:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a10197180 going to sleep for 11 seconds 00000100:00100000:1.0:1788875146.897386:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085056 00000100:00100000:1.0:1788875146.897397:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085056 00000100:00100000:1.0:1788875146.897499:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788875146.897510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875771241085056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788875146.897879:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875771241085056:12345-0@lo:1000:mdt00_002.0 Request processed in 370us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.897887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788875146.898438:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788875146.898445:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788875146.898473:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e5a355e5f80 x1875771241084416/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788875162 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875146.898486:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875771241085056:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788875146.899534:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788875146.899974:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875771241085184:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788875146.900037:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875146.900100:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875146.900323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085184 00000100:00100000:0.0:1788875146.900330:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085184 00000100:00100000:1.0:1788875146.900491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788875146.900502:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875771241085184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788875146.900719:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1875771241085184:12345-0@lo:1000:mdt00_002.0 Request processed in 219us (681us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788875146.900727:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788875146.900816:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875771241085184:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788875146.900848:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900858:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900866:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900881:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875146.900885:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900894:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900909:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8b00) 00010000:00010000:2.0:1788875146.900912:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875146.900916:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900923:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8318a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900950:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900955:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900961:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900966:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875146.900969:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900975:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.900990:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:2.0:1788875146.900992:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875146.900998:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.901010:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.901019:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.901044:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.901065:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241085312:192.168.202.7@tcp:105: 00000100:00100000:2.0:1788875146.901124:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.905453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875146.906116:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875771241085312:192.168.202.7@tcp:105: 00010000:00010000:0.0:1788875146.906145:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d830cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906300:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906315:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906328:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906338:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906360:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906366:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906380:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.906386:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906393:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906406:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.906409:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875146.906413:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0a00/0x60858e6020d83191 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906429:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906435:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906440:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906445:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875146.906454:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906460:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906469:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875146.906471:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788875146.906474:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875146.906480:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15200/0x60858e6020d83183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875146.906807:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:11634:x1875771218033792:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 18835us (19059us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788875146.906820:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 230 00000020:00080000:0.0:1788875146.906827:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788875146.907998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218034048 00000100:00100000:1.0:1788875146.908012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218034048 00000100:00100000:1.0:1788875146.908078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:1.0:1788875146.908088:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:11633:x1875771218034048:12345-192.168.202.7@tcp:49:lfs.0 00000100:00100000:1.0:1788875146.908236:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:11633:x1875771218034048:12345-192.168.202.7@tcp:49:lfs.0 Request processed in 149us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.908244:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 61 00000100:00100000:0.0:1788875146.911520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875146.911596:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218034304 00000100:00100000:1.0:1788875146.911609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218034304 00000100:00100000:1.0:1788875146.911690:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 62 00000100:00100000:1.0:1788875146.911701:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+23:11634:x1875771218034304:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788875146.912447:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788875146.912555:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788875146.912603:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912621:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912634:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912642:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912648:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912654:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.912685:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788875146.912820:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:11634:x1875771218034304:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1118us (1307us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788875146.912828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 62 00000020:00080000:1.0:1788875146.912833:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788875146.914043:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875146.914078:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.914086:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875146.914092:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.914101:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.914119:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e5a10bf8900) 00010000:00010000:3.0:1788875146.914121:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788875146.914126:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.914131:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34400/0x60858e6020d83198 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.914174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875146.914176:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875146.914177:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788875146.915128:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875146.915136:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875146.915627:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788875146.915636:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788875146.920879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.921077:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218034560 00000100:00100000:3.0:1788875146.921089:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218034560 00000100:00100000:3.0:1788875146.921145:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:3.0:1788875146.921154:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:11633:x1875771218034560:12345-192.168.202.7@tcp:58:lfs.0 00000040:00080000:3.0:1788875146.921420:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788875146.921505:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:11633:x1875771218034560:12345-192.168.202.7@tcp:58:lfs.0 Request processed in 351us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.921513:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 231 00000100:00100000:1.0:1788875146.972718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875146.972826:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218034688 00000100:00100000:2.0:1788875146.972835:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218034688 00000100:00100000:2.0:1788875146.972897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 232 00000100:00100000:2.0:1788875146.972908:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+25:11636:x1875771218034688:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875146.972945:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875146.972967:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8319f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ebd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973056:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973082:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973089:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973095:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973339:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973350:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 26 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973359:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973401:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 26 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875146.973423:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 26 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.973437:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241085440:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875146.973584:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875146.979077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.979499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218034944 00000100:00100000:3.0:1788875146.979510:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218034944 00000100:00100000:3.0:1788875146.979584:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:3.0:1788875146.979595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:5590:x1875771218034944:12345-192.168.202.7@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788875146.979865:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:5590:x1875771218034944:12345-192.168.202.7@tcp:35:ldlm_bl.0 Request processed in 271us (807us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788875146.979873:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 63 00000100:00100000:1.0:1788875146.980971:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875771241085440:192.168.202.7@tcp:104: 00010000:00010000:1.0:1788875146.980999:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875146.982999:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875146.983092:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035072 00000100:00100000:3.0:1788875146.983101:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035072 00010000:00010000:3.0:1788875146.983140:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 28 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875146.983198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:3.0:1788875146.983208:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:2348:x1875771218035072:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875146.983229:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875146.983236:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 28 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983250:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 28 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983273:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d830bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e7e expref: 28 pid: 8216 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983289:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875146.983294:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983302:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983324:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875146.983360:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875146.983425:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:2348:x1875771218035072:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 217us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875146.983433:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00010000:00010000:1.0:1788875146.983556:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983565:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875146.983612:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788875146.983616:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788875146.983638:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983652:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983661:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983667:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983673:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983679:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.983684:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983692:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983701:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:1.0:1788875146.983710:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875146.983715:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983722:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19400/0x60858e6020d831a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983734:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983739:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983745:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983749:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875146.983751:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983757:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983764:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e5a045ba200) 00010000:00010000:1.0:1788875146.983767:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788875146.983769:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983831:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18a00/0x60858e6020d831ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983869:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d8319f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ebd expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983893:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ebd expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875146.983899:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875146.983901:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788875146.983904:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c45c00, rc 0) 00000100:00100000:1.0:1788875146.983930:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11636:x1875771218034688:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 11025us (11225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875146.983937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 232 00010000:00010000:2.0:1788875147.022140:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875147.045750:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875147.045825:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875147.045832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035200 00000100:00100000:1.0:1788875147.045845:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035200 00000100:00100000:2.0:1788875147.045855:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875147.045880:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875147.045909:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 300 00000100:00100000:1.0:1788875147.045921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218035200:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875147.046002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218035200:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875147.046010:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 300 00000100:00100000:0.0:1788875147.046173:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035456 00000100:00100000:0.0:1788875147.046178:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035456 00000100:00100000:0.0:1788875147.046224:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035328 00000100:00100000:0.0:1788875147.046227:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035328 00000100:00100000:0.0:1788875147.046246:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:0.0:1788875147.046254:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218035456:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875147.046285:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218035456:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875147.046291:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:0.0:1788875147.046306:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1788875147.046313:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218035328:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875147.046354:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218035328:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 42us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875147.046361:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1788875147.046399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035584 00000100:00100000:0.0:1788875147.046403:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035584 00000100:00100000:0.0:1788875147.046436:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 157 00000100:00100000:0.0:1788875147.046444:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218035584:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875147.046472:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218035584:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875147.046478:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 157 00000100:00080000:1.0:1788875147.047922:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788875147.047933:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788875147.047936:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875147.086337:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241085696:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875147.086482:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875147.086489:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241085568:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086520:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875147.086551:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241085824:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875147.086593:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875147.086598:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875147.086647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085568 00000100:00100000:3.0:1788875147.086655:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085568 00000100:00100000:3.0:1788875147.086708:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788875147.086716:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241085568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3304:x1875771241085568:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875147.086769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788875147.086821:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085696 00000100:00100000:3.0:1788875147.086825:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085696 00000100:00100000:3.0:1788875147.086862:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085824 00000100:00100000:3.0:1788875147.086866:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085824 00000100:00100000:3.0:1788875147.086891:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241085952 00000100:00100000:3.0:1788875147.086895:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241085952 00000100:00100000:3.0:1788875147.086909:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788875147.086914:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241085696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.086945:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241085696:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875147.086951:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788875147.086964:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788875147.086970:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241085824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.087000:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241085824:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875147.087006:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788875147.087016:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788875147.087021:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.087043:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241085952:12345-0@lo:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875147.087049:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788875147.087064:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875147.087092:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.087103:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241085824:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.087127:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241085568:0@lo:400:kworker.0 00000100:00100000:3.0:1788875147.087136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788875147.599976:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241086080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875147.600059:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875147.600383:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086080 00000100:00100000:1.0:1788875147.600392:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086080 00000100:00100000:1.0:1788875147.600445:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788875147.600457:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241086080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875147.600496:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875147.602321:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241086080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1857us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875147.602341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788875147.608255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241086080:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788875147.637934:0:12626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788875147.637943:0:12626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875147.637986:0:12626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788875147.637992:0:12626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788875147.918065:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875147.918077:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875147.918122:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788875147.918129:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788875147.918641:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241086208:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788875147.918807:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fd8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788875147.927675:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875147.928549:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035712 00000100:00100000:0.0:1788875147.928562:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035712 00000100:00100000:0.0:1788875147.928672:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00100000:0.0:1788875147.928682:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:11648:x1875771218035712:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788875147.928720:0:11390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788875147.928874:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+27:11648:x1875771218035712:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 193us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875147.928883:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 233 00000100:00080000:1.0:1788875147.929135:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875147.930533:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1875771241086208:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788875147.933427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875147.933517:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218035968 00000100:00100000:3.0:1788875147.933527:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218035968 00000100:00100000:3.0:1788875147.933599:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:3.0:1788875147.933610:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+26:11648:x1875771218035968:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875147.933631:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875147.933653:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ec4 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.933805:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d831c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.933822:0:8216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d831c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.933836:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d831c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875147.933847:0:8216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788875147.933968:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ec4 expref: 29 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.933988:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d831c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ec4 expref: 28 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.934014:0:8216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875147.934018:0:8216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875147.934022:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875147.934149:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:11648:x1875771218035968:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 532us (724us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788875147.934156:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 234 00000100:00100000:0.0:1788875147.943987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875147.944073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218036224 00000100:00100000:3.0:1788875147.944083:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218036224 00000100:00100000:3.0:1788875147.944151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 235 00000100:00100000:3.0:1788875147.944161:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:11648:x1875771218036224:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788875147.944240:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.944258:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.944271:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.944976:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.944984:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.944990:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.945013:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875147.945017:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.945025:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.945037:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875147.945040:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788875147.945047:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875147.945054:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14200/0x60858e6020d831d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875147.945355:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788875147.945375:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788875147.946109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:11648:x1875771218036224:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 1944us (2126us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788875147.946119:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 235 00000040:00080000:0.0:1788875147.946415:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788875147.946436:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788875147.948920:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875147.949520:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218036352 00000100:00100000:0.0:1788875147.949532:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218036352 00000100:00100000:0.0:1788875147.949618:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1788875147.949629:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:2347:x1875771218036352:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875147.949646:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875147.949670:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d831c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ec4 expref: 29 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875147.949688:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875147.949694:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875147.949756:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:2347:x1875771218036352:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 129us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875147.949764:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1788875147.953724:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875147.954318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218036608 00000100:00100000:3.0:1788875147.954328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218036608 00000100:00100000:3.0:1788875147.954502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 64 00000100:00100000:3.0:1788875147.954513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+28:11648:x1875771218036608:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788875147.955535:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:11648:x1875771218036608:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 1019us (1827us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788875147.955546:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 64 00010000:00010000:0.0:1788875148.046174:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875149.069959:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788875149.498399:0:12678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788875149.498410:0:12678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875149.499202:0:12678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788875149.499210:0:12678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788875149.707071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875149.707153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218036864 00000100:00100000:0.0:1788875149.707168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218036864 00000100:00100000:0.0:1788875149.707251:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 236 00000100:00100000:0.0:1788875149.707263:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+29:11668:x1875771218036864:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875149.707287:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875149.707311:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d831d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ecb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.707419:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d831de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.707433:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d831de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.707468:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d831de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875149.707481:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:1.0:1788875149.707764:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788875149.707875:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1e00/0x60858e6020d831d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ecb expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.707893:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d831de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ecb expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.707902:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:0.0:1788875149.707904:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788875149.707907:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1c00, rc 0) 00000100:00100000:0.0:1788875149.708077:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:11668:x1875771218036864:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 816us (1021us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788875149.708084:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 236 00000100:00100000:2.0:1788875149.719935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875149.720033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218036992 00000100:00100000:1.0:1788875149.720048:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218036992 00000100:00100000:1.0:1788875149.720120:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:1.0:1788875149.720130:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:11668:x1875771218036992:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:1.0:1788875149.720201:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720230:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720258:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720265:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720271:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720277:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875149.720281:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720289:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:1.0:1788875149.720314:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875149.720319:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875149.720326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34600/0x60858e6020d831ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875149.720419:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+31:11668:x1875771218036992:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 291us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875149.720427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 237 00000100:00100000:1.0:1788875149.877014:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875149.877322:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037120 00000100:00100000:0.0:1788875149.877332:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037120 00000100:00100000:0.0:1788875149.877444:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00100000:0.0:1788875149.877455:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2350:x1875771218037120:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1788875149.877473:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875149.877494:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a15968c3/0x60858e6020d831f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ed2 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875149.877519:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa0118a, atime: 0x6aa0118a, ctime: 0x6aa0118a, blocks: 0xb 00010000:00010000:0.0:1788875149.877539:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788875149.877556:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875149.877567:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a15968c3/0x60858e6020d831f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed2 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.877588:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a15968c3/0x60858e6020d831f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed2 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875149.877602:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1e00, rc 0) 00000100:00100000:0.0:1788875149.877669:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2350:x1875771218037120:12345-192.168.202.7@tcp:101:cat.0 Request processed in 216us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875149.877676:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 70 00000100:00080000:1.0:1788875149.877748:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875149.885634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875149.885823:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037248 00000100:00100000:0.0:1788875149.885834:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037248 00002000:00100000:0.0:1788875149.885885:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e5a3f7fad80 x1875771218037248/t0(0) o3->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:55/0 lens 488/0 e 0 to 0 dl 1788875160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788875149.885897:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3f7fad80 with x1875771218037248 ext(0->4095) 00002000:00010000:0.0:1788875149.885903:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3f7fad80 00000100:00100000:0.0:1788875149.885934:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1788875149.885944:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2349:x1875771218037248:12345-192.168.202.7@tcp:3:cat.0 00000100:00100000:1.0:1788875149.886635:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2349:x1875771218037248:12345-192.168.202.7@tcp:3:cat.0 Request processed in 688us (1007us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788875149.886644:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00002000:00100000:1.0:1788875149.886652:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e5a3f7fad80 x1875771218037248/t0(0) o3->dd989c2b-3da6-48fe-ae0a-99ed44fd91eb@192.168.202.7@tcp:55/0 lens 488/4536 e 0 to 0 dl 1788875160 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788875149.886660:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5a3f7fad80 with x1875771218037248 ext(0->4095) 00002000:00010000:1.0:1788875149.886663:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5a3f7fad80 00010000:00010000:3.0:1788875150.094088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788875150.204491:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788875150.204504:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788875150.204512:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788875151.120891:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788875151.693976:0:6900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366559199320ns, next at 367559195865ns, rc = 0 00000100:00100000:2.0:1788875151.694201:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875151.694234:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241086336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875151.694346:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875151.694501:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086336 00000100:00100000:0.0:1788875151.694511:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086336 00000100:00100000:0.0:1788875151.694593:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788875151.694612:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241086336:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788875151.694730:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788875151.694843:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875151.695847:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875771241086336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1230us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875151.695858:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788875151.705369:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241086336:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788875151.832242:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788875151.832281:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788875151.832294:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788875151.832346:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788875151.832365:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1788875151.832408:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5a04fd8540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788875151.832414:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a04874600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a04fd8480 00000020:00080000:3.0:1788875151.832417:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5a04874100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5a3c4c3000 00000020:00080000:1.0:1788875151.832446:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000100:00100000:2.0:1788875151.832742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241086464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788875151.832870:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788875151.833986:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788875151.835150:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086464 00000100:00100000:0.0:1788875151.835169:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086464 00000100:00100000:0.0:1788875151.835271:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788875151.835285:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875771241086464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788875151.835567:0:6901:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788875151.835571:0:6901:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788875146 -> 1788875146 00002000:00010000:0.0:1788875151.835574:0:6901:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788875146 -> 1788875146 00002000:00010000:0.0:1788875151.835576:0:6901:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788875146 -> 1788875146 00002000:00010000:0.0:1788875151.835579:0:6901:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788875151.835686:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1875771241086464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 404us (2814us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788875151.835695:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1788875151.835802:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a3cd88e00/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788875151.835811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241086464:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788875152.146674:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875152.156963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875152.157264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037376 00000100:00100000:0.0:1788875152.157279:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037376 00000100:00100000:0.0:1788875152.157362:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 302 00000100:00100000:0.0:1788875152.157387:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218037376:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875152.157497:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218037376:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 124us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875152.157506:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 302 00000100:00100000:2.0:1788875152.160090:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875152.160144:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875152.160173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875152.160229:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875152.160269:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037632 00000100:00100000:1.0:1788875152.160269:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037888 00000100:00100000:2.0:1788875152.160281:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037632 00000100:00100000:1.0:1788875152.160281:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037888 00000100:00100000:3.0:1788875152.160356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037504 00000100:00100000:3.0:1788875152.160361:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037504 00000100:00100000:2.0:1788875152.160418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218037760 00000100:00100000:2.0:1788875152.160422:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218037760 00000100:00100000:1.0:1788875152.160423:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 161 00000100:00100000:2.0:1788875152.160447:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1788875152.160452:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218037888:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875152.160455:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2350:x1875771218037632:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875152.160553:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2350:x1875771218037888:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 103us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875152.160562:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 161 00000100:00100000:0.0:1788875152.160566:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:0.0:1788875152.160576:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771218037760:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875152.160940:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+8:2350:x1875771218037632:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 484us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.160952:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00080000:2.0:1788875152.160977:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788875152.160982:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788875152.160984:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875152.162466:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2350:x1875771218037760:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1876us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875152.162481:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:3.0:1788875152.163225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:3.0:1788875152.163248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2350:x1875771218037504:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875152.164889:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5905d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2350:x1875771218037504:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 1641us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875152.164906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 162 00000100:00100000:2.0:1788875152.220221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220411:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220493:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875152.220500:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241086976:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220533:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220610:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241087232:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220634:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220652:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875152.220657:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.220822:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875152.220861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086592 00000100:00100000:2.0:1788875152.220871:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086592 00000100:00100000:2.0:1788875152.220937:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788875152.220948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.221012:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241086592:12345-0@lo:400:kworker.0 Request processed in 66us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.221021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788875152.221062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087104 00000100:00100000:2.0:1788875152.221067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087104 00000100:00100000:2.0:1788875152.221111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086720 00000100:00100000:2.0:1788875152.221115:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086720 00000100:00100000:2.0:1788875152.221828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086848 00000100:00100000:2.0:1788875152.221837:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086848 00000100:00100000:2.0:1788875152.221860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788875152.221869:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241087104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222068:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0483df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241087104:12345-0@lo:400:kworker.0 Request processed in 199us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.222094:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788875152.222110:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788875152.222117:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222223:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241086720:12345-0@lo:400:kworker.0 Request processed in 107us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.222230:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788875152.222242:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788875152.222249:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222278:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241086848:12345-0@lo:400:kworker.0 Request processed in 29us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.222285:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788875152.222351:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222370:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222427:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222440:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241086720:0@lo:400:kworker.0 00000100:00080000:2.0:1788875152.222463:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875152.222478:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241086976 00000100:00100000:2.0:1788875152.222482:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241086976 00000100:00100000:2.0:1788875152.222523:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087232 00000100:00100000:2.0:1788875152.222527:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087232 00000100:00100000:2.0:1788875152.222559:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788875152.222566:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875771241086976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.222607:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875771241086976:12345-0@lo:400:kworker.0 Request processed in 41us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.222623:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788875152.222636:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788875152.222641:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241087232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875152.223632:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241087232:12345-0@lo:400:kworker.0 Request processed in 984us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875152.223643:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788875152.223709:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241086976:0@lo:400:kworker.0 00000100:00080000:2.0:1788875152.223740:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875152.224072:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788875152.224079:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788875152.224103:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a355e4a80, transno 4294967310 00000100:00100000:3.0:1788875152.224131:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a0483e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241087232:0@lo:400:kworker.0 00000001:00080000:3.0:1788875152.268352:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788875152.268372:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1788875152.718245:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241087360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875152.718361:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875152.718735:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087360 00000100:00100000:1.0:1788875152.718745:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087360 00000100:00100000:1.0:1788875152.718835:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788875152.718847:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241087360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875152.718904:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875152.719084:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241087360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875152.719092:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788875152.720419:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241087360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788875153.168947:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875154.191001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875155.214400:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875155.566353:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875155.566405:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038016 00000100:00100000:2.0:1788875155.566418:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038016 00000100:00100000:2.0:1788875155.566502:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 238 00000100:00100000:2.0:1788875155.566516:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11313:x1875771218038016:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788875155.566669:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11313:x1875771218038016:12345-192.168.202.7@tcp:60:lhsmtool_posix.0 Request processed in 155us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875155.566678:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 238 00000100:00080000:2.0:1788875155.566712:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875155.575934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875155.576218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038272 00000100:00100000:1.0:1788875155.576234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038272 00000100:00100000:1.0:1788875155.576319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:1.0:1788875155.576332:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:11313:x1875771218038272:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788875155.577092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:11313:x1875771218038272:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 758us (1169us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788875155.577103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 65 00000100:00100000:2.0:1788875155.916108:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875155.919106:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038400 00000100:00100000:0.0:1788875155.919132:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038400 00000100:00100000:0.0:1788875155.919366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 239 00000100:00100000:0.0:1788875155.919379:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:12119:x1875771218038400:12345-192.168.202.7@tcp:101:lsof.0 00010000:00010000:0.0:1788875155.919410:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875155.919453:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d831fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ed9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919556:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919591:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875155.919652:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875155.919658:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875155.919687:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919717:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d831fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed9 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919769:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed9 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875155.919941:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:0.0:1788875155.919945:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875155.919950:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1200, rc 0) 00000100:00100000:0.0:1788875155.920051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:12119:x1875771218038400:12345-192.168.202.7@tcp:101:lsof.0 Request processed in 673us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875155.920060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 239 00000100:00080000:2.0:1788875155.921030:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788875156.240001:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875156.814292:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788875156.814333:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241087488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875156.814444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875156.814723:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087488 00000100:00100000:0.0:1788875156.814735:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087488 00000100:00100000:0.0:1788875156.814851:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788875156.814864:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241087488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875156.814915:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875156.814984:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241087488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875156.814992:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788875156.815044:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788875156.815053:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a355e5f80, transno 4294967321 00000004:00080000:0.0:1788875156.815065:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967324 00000004:00080000:0.0:1788875156.815088:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a3cd88e00, transno 4294967324 00000100:00100000:0.0:1788875156.815104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241087488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788875156.816019:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788875156.891498:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788875156.891524:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788875156.891643:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788875156.891658:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788875157.198355:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875157.198371:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875157.199543:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788875157.199557:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788875157.262520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875157.279640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875157.279703:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875157.279812:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875157.281181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038528 00000100:00100000:3.0:1788875157.281202:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038528 00000100:00100000:3.0:1788875157.281319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 304 00000100:00100000:3.0:1788875157.281333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218038528:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875157.281448:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218038528:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 117us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875157.281457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 304 00000100:00100000:0.0:1788875157.281714:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038784 00000100:00100000:0.0:1788875157.281720:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038784 00000100:00100000:0.0:1788875157.281810:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1788875157.281819:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218038784:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875157.281916:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039040 00000100:00100000:1.0:1788875157.281923:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039040 00000100:00080000:3.0:1788875157.282017:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788875157.282023:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875157.282057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:1.0:1788875157.282067:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218039040:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875157.284453:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218038784:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 2617us (4729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875157.284473:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:1.0:1788875157.287859:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218039040:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 5774us (8024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875157.287908:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 166 00000100:00100000:2.0:1788875157.295931:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875157.296067:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875157.299581:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038912 00000100:00100000:3.0:1788875157.299621:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038912 00000100:00100000:3.0:1788875157.299760:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:3.0:1788875157.299822:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218038912:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875157.299935:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218038912:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 163us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875157.299944:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00080000:1.0:1788875157.301538:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875157.303787:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218038656 00000100:00100000:0.0:1788875157.303814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218038656 00000100:00100000:0.0:1788875157.303950:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00100000:0.0:1788875157.303966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2348:x1875771218038656:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875157.304114:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2348:x1875771218038656:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 152us (8199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875157.304123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 167 00000100:00080000:1.0:1788875157.304249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875157.334111:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241087744:0@lo:400:kworker.0 00000100:00100000:3.0:1788875157.334212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875157.334366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875157.334385:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241087616:0@lo:400:kworker.0 00000100:00100000:2.0:1788875157.334438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875157.334486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087616 00000100:00100000:2.0:1788875157.334495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087616 00000100:00100000:2.0:1788875157.334553:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788875157.334562:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241087616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875157.334633:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241087616:12345-0@lo:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875157.334641:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788875157.334694:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241087616:0@lo:400:kworker.0 00000100:00100000:2.0:1788875157.335815:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241087872:0@lo:400:kworker.0 00000100:00100000:2.0:1788875157.335874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875157.335927:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087744 00000100:00100000:2.0:1788875157.335934:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087744 00000100:00100000:2.0:1788875157.335987:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241087872 00000100:00100000:2.0:1788875157.335990:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241087872 00000100:00100000:2.0:1788875157.336024:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788875157.336032:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.336138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788875157.336149:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241087872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.336190:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875771241087872:12345-0@lo:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875157.336197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788875157.336239:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875771241087872:0@lo:400:kworker.0 00000100:00080000:0.0:1788875157.336306:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875157.339921:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241088128:0@lo:400:kworker.0 00000100:00100000:1.0:1788875157.340086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875157.340149:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788875157.340157:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241088000:0@lo:400:kworker.0 00000100:00100000:1.0:1788875157.340190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875157.340226:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088128 00000100:00100000:1.0:1788875157.340236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088128 00000100:00100000:1.0:1788875157.340316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788875157.340327:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241088128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875157.340389:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241088128:12345-0@lo:400:kworker.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875157.341525:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788875157.342107:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788875157.342134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.342212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875157.342268:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088000 00000100:00100000:0.0:1788875157.342285:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088000 00000100:00100000:0.0:1788875157.342335:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088256 00000100:00100000:0.0:1788875157.342338:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088256 00000100:00100000:0.0:1788875157.342391:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788875157.342723:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241088128:0@lo:400:kworker.0 00000100:00080000:1.0:1788875157.342757:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788875157.342764:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875157.342815:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788875157.342825:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241088256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875157.342894:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241088256:12345-0@lo:400:kworker.0 Request processed in 71us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875157.342902:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788875157.342933:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.343047:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241088000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.343090:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241088000:12345-0@lo:400:kworker.0 Request processed in 693us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875157.343096:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788875157.343141:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241088000:0@lo:400:kworker.0 00000100:00100000:2.0:1788875157.344073:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241087744:12345-0@lo:400:kworker.0 Request processed in 8036us (9856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875157.344100:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788875157.345570:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241087744:0@lo:400:kworker.0 00000100:00100000:0.0:1788875157.838846:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241088384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875157.838953:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875157.839141:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088384 00000100:00100000:2.0:1788875157.839153:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088384 00000100:00100000:2.0:1788875157.839239:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788875157.839251:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241088384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788875157.839313:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875157.840215:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241088384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 959us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875157.840227:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788875157.840424:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241088384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788875158.286743:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875159.332699:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875159.496504:0:12879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:45:58 (1788875158) 00010000:00010000:1.0:1788875160.340954:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875161.358122:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875161.946202:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a34ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241088512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875161.946313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875161.946433:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088512 00000100:00100000:0.0:1788875161.946443:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088512 00000100:00100000:0.0:1788875161.946507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788875161.946516:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241088512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788875161.949867:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788875161.951563:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875161.951791:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241088512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5248us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875161.951805:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788875161.951910:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a34ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241088512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788875162.381954:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875162.396089:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875162.396120:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875162.396237:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039296 00000100:00100000:0.0:1788875162.396246:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039296 00000100:00100000:1.0:1788875162.396305:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039552 00000100:00100000:0.0:1788875162.396311:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:1.0:1788875162.396312:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039552 00000100:00100000:0.0:1788875162.396324:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2348:x1875771218039296:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875162.396354:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:1.0:1788875162.396365:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218039552:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875162.396434:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:2348:x1875771218039296:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875162.396443:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 171 00000100:00100000:1.0:1788875162.397010:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2348:x1875771218039552:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 645us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875162.397018:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00080000:1.0:1788875162.397044:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788875162.397049:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875162.401101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875162.401248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039168 00000100:00100000:0.0:1788875162.401258:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039168 00000100:00100000:0.0:1788875162.401312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 306 00000100:00100000:0.0:1788875162.401321:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218039168:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875162.401375:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f85827f-e9c9-452e-88ac-d3df48643465+13:2348:x1875771218039168:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875162.401381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 306 00000100:00100000:3.0:1788875162.403992:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875162.404068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875162.404131:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039424 00000100:00100000:2.0:1788875162.404148:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039424 00000100:00100000:2.0:1788875162.404211:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00100000:2.0:1788875162.404222:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218039424:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875162.404302:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2348:x1875771218039424:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875162.404308:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 92 00000100:00080000:0.0:1788875162.407558:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875162.408923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039680 00000100:00100000:1.0:1788875162.408935:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039680 00000100:00100000:1.0:1788875162.409042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00100000:1.0:1788875162.409051:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218039680:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875162.411254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2348:x1875771218039680:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 86us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875162.411277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 172 00000100:00080000:0.0:1788875162.412127:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875162.446874:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875162.446899:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241088640:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.446977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875162.447639:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788875162.447682:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875162.447712:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875162.447718:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241089152:0@lo:400:kworker.0 00000100:00100000:1.0:1788875162.447745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875162.447799:0:11390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089152 00000100:00100000:1.0:1788875162.447806:0:11390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089152 00000100:00100000:1.0:1788875162.447863:0:11390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788875162.447872:0:11390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241089152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875162.447944:0:11390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241089152:12345-0@lo:400:kworker.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875162.447951:0:11390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788875162.447983:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089024 00000100:00100000:1.0:1788875162.447987:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089024 00000100:00100000:1.0:1788875162.448010:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788875162.448016:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241089024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875162.448047:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241089024:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875162.448054:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788875162.448094:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241089152:0@lo:400:kworker.0 00000100:00100000:1.0:1788875162.448105:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241089024:0@lo:400:kworker.0 00000100:00080000:1.0:1788875162.448125:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875162.448327:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241088768:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448360:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875162.448391:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241089280:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875162.448432:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875162.448446:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241088896:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448472:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875162.448510:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088768 00000100:00100000:2.0:1788875162.448515:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088768 00000100:00100000:2.0:1788875162.448540:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088896 00000100:00100000:2.0:1788875162.448543:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088896 00000100:00100000:2.0:1788875162.448562:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788875162.448569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241088768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448606:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241088768:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875162.448612:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788875162.448625:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788875162.448630:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241088896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241088896:12345-0@lo:400:kworker.0 Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875162.448660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788875162.448684:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241088896:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448693:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241088768:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448713:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089280 00000100:00100000:2.0:1788875162.448716:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089280 00000100:00100000:2.0:1788875162.448742:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788875162.448748:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.448813:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241089280:12345-0@lo:400:kworker.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875162.448819:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788875162.448843:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241089280:0@lo:400:kworker.0 00000100:00080000:1.0:1788875162.449651:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788875162.449657:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875162.451327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241088640 00000100:00100000:3.0:1788875162.451343:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241088640 00000100:00100000:3.0:1788875162.451400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788875162.451411:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875162.451510:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241088640:12345-0@lo:400:kworker.0 Request processed in 102us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875162.451517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788875162.451686:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241088640:0@lo:400:kworker.0 00000100:00100000:2.0:1788875162.958083:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875162.958108:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241089408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875162.958192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875162.958511:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089408 00000100:00100000:1.0:1788875162.958520:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089408 00000100:00100000:1.0:1788875162.958575:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788875162.958584:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241089408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875162.958621:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875162.958688:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241089408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875162.958695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788875162.958883:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241089408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875163.407093:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875164.368327:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875164.368502:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218039936 00000100:00100000:1.0:1788875164.368525:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218039936 00000100:00100000:1.0:1788875164.368608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00100000:1.0:1788875164.368620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+18:12341:x1875771218039936:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:1.0:1788875164.369024:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:12341:x1875771218039936:12345-192.168.202.7@tcp:35:umount.0 Request processed in 406us (703us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788875164.369032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 66 00000100:00080000:2.0:1788875164.369088:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875164.378396:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875164.381956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218040192 00000100:00100000:1.0:1788875164.381976:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218040192 00000100:00100000:1.0:1788875164.382060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:1.0:1788875164.382071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+19:12341:x1875771218040192:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:1.0:1788875164.382528:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:12341:x1875771218040192:12345-192.168.202.7@tcp:35:umount.0 Request processed in 458us (4151us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788875164.382537:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 67 00000100:00100000:3.0:1788875164.385684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875164.386916:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218040448 00000100:00100000:1.0:1788875164.386939:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218040448 00000100:00100000:1.0:1788875164.387031:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:1.0:1788875164.387042:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+20:12341:x1875771218040448:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:1.0:1788875164.387313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:12341:x1875771218040448:12345-192.168.202.7@tcp:35:umount.0 Request processed in 271us (1643us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788875164.387320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 68 00000100:00100000:0.0:1788875164.400221:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875164.403110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218040704 00000100:00100000:1.0:1788875164.403128:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218040704 00000100:00100000:1.0:1788875164.403256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 69 00000100:00100000:1.0:1788875164.403268:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:12341:x1875771218040704:12345-192.168.202.7@tcp:35:umount.0 00000100:00100000:1.0:1788875164.403693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:12341:x1875771218040704:12345-192.168.202.7@tcp:35:umount.0 Request processed in 424us (3489us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788875164.403715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 69 00010000:00010000:1.0:1788875164.429864:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875164.433480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875164.433524:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875164.433571:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875164.433601:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218040960 00000100:00100000:3.0:1788875164.433620:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218040960 00000100:00100000:0.0:1788875164.433675:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875164.433736:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218040832 00000100:00100000:3.0:1788875164.433743:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218040832 00000100:00100000:2.0:1788875164.433944:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218041088 00000100:00100000:2.0:1788875164.433955:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218041088 00000100:00100000:2.0:1788875164.434026:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 72 00000100:00100000:2.0:1788875164.434038:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+5:2346:x1875771218041088:12345-192.168.202.7@tcp:9:umount.0 00000020:00000080:2.0:1788875164.434071:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d82551 00000100:00080000:2.0:1788875164.434081:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9e5a044af800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788875164.434124:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788875164.434421:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+2:2346:x1875771218041088:12345-192.168.202.7@tcp:9:umount.0 Request processed in 386us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875164.434429:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 72 00010000:00010000:2.0:1788875164.434450:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788875164.434534:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875164.438077:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218041216 00000100:00100000:0.0:1788875164.438092:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218041216 00000100:00100000:0.0:1788875164.438164:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875164.438175:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+15:2350:x1875771218040960:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875164.438193:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875164.438225:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027ea800/0x60858e6020d821df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a2c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875164.438246:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875164.438342:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+14:2350:x1875771218040960:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 168us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875164.438350:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875164.438372:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1788875164.438379:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+13:2350:x1875771218040832:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875164.438387:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875164.438397:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26a00/0x60858e6020d82279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a64 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875164.438407:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875164.438425:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+12:2350:x1875771218040832:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 47us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875164.438431:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1788875164.438443:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:0.0:1788875164.438450:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+11:2347:x1875771218041216:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875164.438457:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875164.438465:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031400/0x60858e6020d82463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b2f expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875164.438474:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875164.438489:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771218041216:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 39us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875164.438494:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:3.0:1788875164.442679:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875164.442847:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218041600 00000100:00100000:2.0:1788875164.442860:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218041600 00000100:00100000:2.0:1788875164.443077:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:2.0:1788875164.443097:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+7:2346:x1875771218041600:12345-192.168.202.7@tcp:9:umount.0 00000100:00080000:0.0:1788875164.443099:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788875164.443145:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d827b9 00000020:00010000:2.0:1788875164.443158:0:6697:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5a06244000: total 0 00000100:00080000:2.0:1788875164.443176:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e5a06241000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788875164.443249:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1788875164.443672:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5a06244000: total 0 00010000:00010000:3.0:1788875164.443725:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5a06244000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788875164.443858:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705868b9/0x60858e6020d82b55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d04 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.444298:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a15968c3/0x60858e6020d831f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed2 expref: 5 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.444315:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5a06244000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788875164.444331:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875164.444333:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875164.444335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875164.444804:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+2:2346:x1875771218041600:12345-192.168.202.7@tcp:9:umount.0 Request processed in 1712us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875164.444827:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 73 00000100:00100000:2.0:1788875164.458319:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875164.459566:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218042624 00000100:00100000:0.0:1788875164.459586:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218042624 00000100:00100000:0.0:1788875164.459684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 240 00000100:00100000:0.0:1788875164.459718:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+22:2346:x1875771218042624:12345-192.168.202.7@tcp:39:umount.0 00000020:00000080:0.0:1788875164.459767:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821ed 00000020:00010000:0.0:1788875164.459843:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5a35469000: total 0 00000100:00080000:0.0:1788875164.459850:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9e5a3546a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788875164.459886:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788875164.460349:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd989c2b-3da6-48fe-ae0a-99ed44fd91eb+21:2346:x1875771218042624:12345-192.168.202.7@tcp:39:umount.0 Request processed in 633us (2039us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788875164.460358:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 240 00000020:00010000:3.0:1788875164.461202:0:7641:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5a35469000: total 0 00010000:00010000:3.0:1788875164.461280:0:7641:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5a35469000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788875164.461329:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875164.461334:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875164.461347:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d82b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cef expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461371:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875164.461373:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788875164.461377:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d82b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cfd expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461391:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875164.461393:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788875164.461397:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d831b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ebd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461483:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875164.461486:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788875164.461510:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d831de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ecb expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461530:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875164.461532:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875164.461537:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b27800/0x60858e6020d82814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0c2b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461551:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a10bf8f00) 00010000:00010000:3.0:1788875164.461553:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875164.461557:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13b26200/0x60858e6020d824b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b3d expref: 15 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461576:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875164.461579:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875164.461583:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b34e00/0x60858e6020d82eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0df9 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461595:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e5a045ba500) 00010000:00010000:3.0:1788875164.461598:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875164.461601:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18200/0x60858e6020d830d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0e85 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461617:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e5a10bf8700) 00010000:00010000:3.0:1788875164.461619:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788875164.461622:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35b35000/0x60858e6020d82bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d27 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461648:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e5a0bc0d600) 00010000:00010000:3.0:1788875164.461656:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875164.461661:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19000/0x60858e6020d82a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0cb7 expref: 11 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461681:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e5a10903300) 00010000:00010000:3.0:1788875164.461684:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788875164.461688:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d82527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b59 expref: 10 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461707:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:3.0:1788875164.461710:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875164.461713:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1800/0x60858e6020d82bb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0d20 expref: 9 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461725:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a045ba400) 00010000:00010000:3.0:1788875164.461728:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875164.461731:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18c00/0x60858e6020d824d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b44 expref: 8 pid: 11390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875164.461743:0:7641:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5a35469000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788875164.461757:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875164.461760:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875164.461761:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875165.454921:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788875165.615001:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:0.0:1788875165.615015:0:7652:0:(genops.c:885:class_export_put()) final put ffff9e5a044ae000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:2.0:1788875165.615165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a044ae000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-OST0001 00000020:00000080:2.0:1788875165.615244:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a044af800 for lustre-OST0001 00000100:00100000:0.0:1788875166.377710:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875166.377766:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875166.377846:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875166.377878:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218042752 00000100:00100000:3.0:1788875166.377888:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218042752 00000100:00100000:3.0:1788875166.377968:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043008 00000100:00100000:3.0:1788875166.377971:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043008 00000100:00100000:3.0:1788875166.377987:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218042880 00000100:00100000:3.0:1788875166.377989:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218042880 00000100:00100000:3.0:1788875166.378006:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875166.378043:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+12:2347:x1875771218042752:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875166.378058:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875166.378091:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27400/0x60858e6020d822bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a79 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875166.378111:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875166.378170:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+11:2347:x1875771218042752:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 129us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875166.378177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875166.378223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:3.0:1788875166.378230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05656c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+10:2347:x1875771218043008:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875166.378238:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875166.378248:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14800/0x60858e6020d8245c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0b28 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875166.378257:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875166.378275:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05656c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+9:2347:x1875771218043008:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 46us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875166.378282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:3.0:1788875166.378323:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1788875166.378330:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+8:2347:x1875771218042880:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875166.378338:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875166.378751:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18800/0x60858e6020d822c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0aa3 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875166.378765:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875166.378972:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e59076e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f85827f-e9c9-452e-88ac-d3df48643465+7:2347:x1875771218042880:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 641us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875166.378980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:1.0:1788875166.385130:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875166.385742:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043264 00000100:00100000:0.0:1788875166.385753:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043264 00000100:00100000:0.0:1788875166.385864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 241 00000100:00100000:0.0:1788875166.385876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+6:2346:x1875771218043264:12345-192.168.202.7@tcp:39:umount.0 00000020:00000080:0.0:1788875166.385921:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d822d4 00000020:00010000:0.0:1788875166.385931:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5a35a8d000: total 0 00000100:00080000:0.0:1788875166.385936:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9e5a35a8c800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788875166.385948:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1788875166.385965:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788875166.386220:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9147e8f4-0bb3-42d1-8da6-705940ef7b80+5:2346:x1875771218043264:12345-192.168.202.7@tcp:39:umount.0 Request processed in 346us (1102us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788875166.386229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 241 00000020:00010000:3.0:1788875166.386721:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5a35a8d000: total 0 00010000:00010000:3.0:1788875166.386801:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5a35a8d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788875166.386838:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0de00) 00010000:00010000:3.0:1788875166.386842:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875166.386850:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83201 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ed9 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875166.386872:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5a35a8d000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788875166.386883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875166.386885:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875166.386887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875166.403821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875166.403929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043520 00000100:00100000:0.0:1788875166.403940:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043520 00000100:00100000:0.0:1788875166.404001:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 308 00000100:00100000:0.0:1788875166.404028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+7:2346:x1875771218043520:12345-192.168.202.7@tcp:251:umount.0 00000020:00000080:0.0:1788875166.404076:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821ca 00000020:00010000:0.0:1788875166.404098:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5a04847000: total 0 00000100:00080000:0.0:1788875166.404103:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9e5a04842000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788875166.404185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f85827f-e9c9-452e-88ac-d3df48643465+3:2346:x1875771218043520:12345-192.168.202.7@tcp:251:umount.0 Request processed in 160us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875166.404273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 308 00000020:00010000:1.0:1788875166.404892:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5a04847000: total 0 00010000:00010000:1.0:1788875166.404897:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875166.404943:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5a04847000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788875166.404977:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b26400/0x60858e6020d82280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0a6b expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875166.404992:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5a04847000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788875166.405001:0:5829:0:(genops.c:885:class_export_put()) final put ffff9e5a04847000/4f85827f-e9c9-452e-88ac-d3df48643465 00010000:00010000:1.0:1788875166.405020:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875166.405022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875166.405024:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788875166.405601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a04847000/4f85827f-e9c9-452e-88ac-d3df48643465 for MGS 00000020:00000080:0.0:1788875166.405644:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a04842000 for MGS 00010000:00010000:3.0:1788875166.478803:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875167.053974:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875167.054018:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a04f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241089536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875167.054131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875167.054594:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089536 00000100:00100000:2.0:1788875167.054609:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089536 00000100:00100000:2.0:1788875167.054712:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788875167.054716:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875167.054726:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241089536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875167.054805:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875167.054886:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241089536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875167.054894:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788875167.054969:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a04f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241089536:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788875167.116637:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000001:00080000:3.0:1788875167.116662:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788875167.116670:0:5863:0:(genops.c:885:class_export_put()) final put ffff9e5a35a8d000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 00000001:00100000:3.0:1788875167.116701:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000001:00080000:3.0:1788875167.116707:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788875167.116726:0:5863:0:(genops.c:885:class_export_put()) final put ffff9e5a35469000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:2.0:1788875167.116802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a35a8d000/9147e8f4-0bb3-42d1-8da6-705940ef7b80 for lustre-MDT0000 00000020:00000080:2.0:1788875167.116871:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a35469000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-MDT0000 00000020:00000080:2.0:1788875167.116918:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a35a8c800 for lustre-MDT0000 00000020:00000080:2.0:1788875167.116925:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3546a000 for lustre-MDT0000 00000040:00080000:2.0:1788875167.439629:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788875167.439641:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788875167.440128:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788875167.440136:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788875167.502065:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875167.576542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241089664:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.576670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875167.576739:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.576794:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875167.576830:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788875167.576839:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241090048:0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.577303:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241089792:0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.582596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875167.582675:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3c58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241090304:0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.582726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875167.582784:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788875167.582794:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e59076e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241089920:0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.582821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875167.584195:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090176 00000100:00100000:0.0:1788875167.584210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090176 00000100:00100000:0.0:1788875167.584299:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089792 00000100:00100000:0.0:1788875167.584303:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089792 00000100:00100000:0.0:1788875167.584325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089920 00000100:00100000:0.0:1788875167.584328:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089920 00000100:00100000:0.0:1788875167.584350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788875167.584361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.584522:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875167.584598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241089664 00000100:00100000:2.0:1788875167.584603:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241089664 00000100:00100000:2.0:1788875167.584641:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788875167.584650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.584735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a06a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3306:x1875771241089664:12345-0@lo:400:kworker.0 Request processed in 86us (8066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875167.584743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788875167.584805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788875167.584814:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241089792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.584856:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241089792:12345-0@lo:400:kworker.0 Request processed in 44us (2275us total) trans 0 rc 0/0 00000100:00080000:1.0:1788875167.585293:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875167.586138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241090176:12345-0@lo:400:kworker.0 Request processed in 1770us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875167.586153:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788875167.586205:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788875167.586218:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241089920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.586260:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241089920:12345-0@lo:400:kworker.0 Request processed in 47us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875167.586267:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788875167.586298:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090304 00000100:00100000:0.0:1788875167.586308:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090304 00000100:00100000:0.0:1788875167.586368:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090048 00000100:00100000:0.0:1788875167.586372:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090048 00000100:00100000:0.0:1788875167.586411:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788875167.586418:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.586455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241090304:12345-0@lo:400:kworker.0 Request processed in 39us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875167.586462:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788875167.586473:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788875167.586479:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241090048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875167.586507:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a04f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241090048:12345-0@lo:400:kworker.0 Request processed in 29us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875167.586512:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788875167.586545:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788875167.587038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788875167.587113:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241090048:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.587125:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241089664:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.587137:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.587200:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241089920:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.587214:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e59076e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241089792:0@lo:400:kworker.0 00000100:00100000:2.0:1788875167.587240:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3c58e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241090304:0@lo:400:kworker.0 00000001:00100000:2.0:1788875167.693118:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:2.0:1788875167.693132:0:6720:0:(genops.c:885:class_export_put()) final put ffff9e5a06244000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb 00000020:00000080:0.0:1788875167.693209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06244000/dd989c2b-3da6-48fe-ae0a-99ed44fd91eb for lustre-OST0000 00000020:00000080:0.0:1788875167.693279:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a06241000 for lustre-OST0000 00000100:00100000:3.0:1788875168.078476:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875168.078510:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241090432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875168.078618:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875168.078757:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090432 00000100:00100000:1.0:1788875168.078802:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090432 00000100:00100000:1.0:1788875168.078962:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788875168.078978:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241090432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788875168.079037:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788875168.079102:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241090432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875168.079109:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788875168.079212:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241090432:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788875168.365016:0:13081:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788875168.381635:0:13081:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788875168.381709:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.381731:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.381757:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.381765:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.381819:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788875168.381826:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788875168.381861:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788875168.381917:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875168.381926:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.381934:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788875168.381946:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.381956:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788875168.381964:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875168.381971:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788875168.381973:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788875168.381976:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788875168.382030:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.382037:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788875168.382079:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.382088:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a18e00/0x60858e6020d8224f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82256 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.382103:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875168.382105:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875168.382107:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875168.382130:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241090560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875168.382239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875168.382327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090560 00000100:00100000:0.0:1788875168.382336:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090560 00000100:00100000:0.0:1788875168.382402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788875168.382413:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+19:3305:x1875771241090560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788875168.382436:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875168.382454:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15800/0x60858e6020d82256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8224f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875168.382466:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875168.382503:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:372e367e-0deb-4060-9f2e-265b56425d5a+18:3305:x1875771241090560:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875168.382510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788875168.382560:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241090560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875168.382692:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788875168.382704:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788875168.382722:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a1811c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788875168.383067:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241090688:0@lo:39:umount.0 00000100:00100000:0.0:1788875168.383109:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875168.383194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090688 00000100:00100000:3.0:1788875168.383200:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090688 00000100:00100000:3.0:1788875168.383248:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788875168.383257:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875771241090688:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788875168.383289:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81fd9 00000100:00080000:3.0:1788875168.383299:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9e5a3c5be000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788875168.383370:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1875771241090688:12345-0@lo:39:umount.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875168.383377:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788875168.383386:0:5841:0:(genops.c:885:class_export_put()) final put ffff9e5a1811b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788875168.383445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a1811b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788875168.383511:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3c5be000 for lustre-MDT0000 00010000:00010000:1.0:1788875168.383570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788875168.383743:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a1811c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788875168.383760:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241090688:0@lo:39:umount.0 00000100:00080000:3.0:1788875168.383862:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788875168.383865:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788875168.383870:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788875168.386693:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386746:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386754:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386762:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386804:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875168.386823:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875168.386831:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386839:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875168.386843:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386854:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875168.386862:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875168.386868:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875168.386871:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788875168.386917:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386935:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875168.386963:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386971:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15000/0x60858e6020d8225d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d82264 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.386986:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.386988:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.386989:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875168.387010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241090816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875168.387102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875168.387200:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090816 00000100:00100000:3.0:1788875168.387209:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090816 00000100:00100000:3.0:1788875168.387277:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788875168.387288:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+18:3306:x1875771241090816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875168.387305:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875168.387324:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13b27600/0x60858e6020d82264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8225d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387340:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875168.387383:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:372e367e-0deb-4060-9f2e-265b56425d5a+17:3306:x1875771241090816:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875168.387390:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788875168.387438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241090816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875168.387469:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387489:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387496:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387502:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387516:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875168.387523:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387528:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387548:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387554:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387565:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788875168.387570:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387575:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387591:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387598:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387613:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788875168.387618:0:13081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788875168.387622:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788875168.387653:0:13081:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788875168.387658:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788875168.387663:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875168.387670:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788875168.387676:0:13081:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e5a3f776800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788875168.387683:0:13081:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e5904e8e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788875168.387688:0:13081:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e5a362b99c0) has exports, disconnecting them 00000020:00080000:3.0:1788875168.387694:0:13081:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e5a3f776800), last request at 1788875167 00000020:00000080:3.0:1788875168.387703:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d8214c 00000100:00080000:3.0:1788875168.387724:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a3f772800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788875168.387802:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788875168.387808:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387815:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a027eba00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875168.387818:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387827:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875168.387840:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875168.387846:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875168.387849:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788875168.387851:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788875168.387869:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387876:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875168.387897:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387904:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a027eba00/0x60858e6020d82184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8218b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387919:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788875168.387923:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387928:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a00031a00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875168.387931:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.387938:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875168.387944:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875168.388022:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788875168.388024:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788875168.388026:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788875168.388041:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388048:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875168.388055:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388061:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a00031a00/0x60858e6020d82486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8248d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388072:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875168.388075:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388081:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13b27c00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875168.388084:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388090:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875168.388096:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875168.388102:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875168.388104:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788875168.388105:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788875168.388124:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388129:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875168.388141:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388148:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27c00/0x60858e6020d81f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d81f3f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.388159:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.388161:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.388162:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875168.388184:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788875168.388195:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241091200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875168.388236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788875168.388276:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5a3f776800): rc 0 00000020:00000080:3.0:1788875168.388278:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a3f776800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788875168.388290:0:13081:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e5904e8e800), last request at 1788875167 00000020:00000080:3.0:1788875168.388293:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d82081 00000100:00080000:3.0:1788875168.388300:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a3c5b9000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788875168.388314:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3f776800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788875168.388365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3f772800 for lustre-MDT0000 00010000:00010000:3.0:1788875168.388376:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788875168.388385:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5904e8e800): rc 0 00000020:00000080:3.0:1788875168.388387:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5904e8e800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788875168.388399:0:13081:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae1241677ae0 00000020:00000080:3.0:1788875168.388412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904e8e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788875168.388448:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3c5b9000 for lustre-MDT0000 00000100:00080000:3.0:1788875168.388476:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788875168.388486:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788875168.388502:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788875168.388535:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241091200 00000100:00100000:1.0:1788875168.388543:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241091200 00000100:00080000:3.0:1788875168.388565:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788875168.388580:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788875168.388592:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788875168.388594:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788875168.388604:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788875168.388662:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788875168.388662:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788875168.388669:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a36169800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788875168.388671:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+17:3306:x1875771241091200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875168.388683:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875168.388695:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14e00/0x60858e6020d81f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d81f38 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788875168.388701:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e5a362b99c0) has no exports 00010000:00010000:1.0:1788875168.388710:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875168.389209:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241091072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875168.389250:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3306:x1875771241091200:12345-0@lo:103:ldlm_bl.0 Request processed in 578us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875168.389251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875168.389258:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788875168.389286:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241091072 00000100:00100000:2.0:1788875168.389291:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875168.389291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241091072 00000100:00100000:2.0:1788875168.389296:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241090944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875168.389319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875168.389323:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788875168.389330:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3304:x1875771241091072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875168.389339:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788875168.389347:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241090944 00000100:00100000:2.0:1788875168.389350:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241090944 00010000:00010000:1.0:1788875168.389350:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18600/0x60858e6020d8248d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82486 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875168.389359:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875168.389376:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788875168.389383:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+16:3304:x1875771241090944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875168.389387:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3c58e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:372e367e-0deb-4060-9f2e-265b56425d5a+16:3304:x1875771241091072:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1788875168.389392:0:8459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788875168.389393:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788875168.389400:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027eaa00/0x60858e6020d8218b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82184 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875168.389412:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875168.389413:0:8459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788875168.389420:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875168.389433:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372e367e-0deb-4060-9f2e-265b56425d5a+14:3304:x1875771241090944:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875168.389439:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788875168.389636:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241090944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875168.389645:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:372e367e-0deb-4060-9f2e-265b56425d5a:3304:1875771241091072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875168.390712:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875168.390795:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:372e367e-0deb-4060-9f2e-265b56425d5a:3306:1875771241091200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875168.392907:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241091328:0@lo:9:umount.0 00000100:00100000:0.0:1788875168.393018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875168.393077:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241091456:0@lo:9:umount.0 00000100:00100000:0.0:1788875168.393104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875168.393161:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241091328 00000100:00100000:0.0:1788875168.393183:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241091328 00000100:00100000:0.0:1788875168.393244:0:6901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241091456 00000100:00100000:0.0:1788875168.393247:0:6901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241091456 00000100:00100000:0.0:1788875168.393275:0:6901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788875168.393285:0:6901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875771241091328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788875168.393323:0:6901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d820ce 00000100:00080000:0.0:1788875168.393359:0:6901:0:(import.c:65:import_set_state_nolock()) ffff9e5904ede800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788875168.393412:0:6901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788875168.393681:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788875168.393693:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875771241091456:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788875168.393708:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821b5 00000100:00080000:3.0:1788875168.393715:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9e5904e8b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788875168.393749:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788875168.394202:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1875771241091456:12345-0@lo:9:umount.0 Request processed in 511us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875168.394210:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788875168.394472:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875168.394514:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875168.394558:0:6901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3302:x1875771241091328:12345-0@lo:9:umount.0 Request processed in 1274us (1540us total) trans 0 rc 0/0 00000100:00080000:1.0:1788875168.394562:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a36169800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788875168.394567:0:6901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1788875168.394625:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788875168.402493:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788875168.402515:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241091456:0@lo:9:umount.0 00000100:00080000:1.0:1788875168.402596:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788875168.402622:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788875168.402624:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788875168.402628:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241091328:0@lo:9:umount.0 00000020:00080000:3.0:1788875168.417213:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e5a362b99c0) has no exports 00000020:00000080:3.0:1788875168.478947:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f93 00000020:00000080:3.0:1788875168.478966:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a3c5ba000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788875168.479040:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788875168.479271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3c5ba000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788875168.479298:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788875168.479308:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788875168.479312:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e5a0623cd40) has no exports 00000020:00000080:0.0:1788875168.479890:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f8c 00000020:00000080:0.0:1788875168.479901:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a37381000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788875168.479971:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a37381000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788875168.480033:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788875168.480041:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788875168.480044:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a37382000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788875168.480046:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a37382000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788875168.480051:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1788875168.480166:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a35955120 - data ffff9e5a3febb288/ffff9e5a3c525400 00000020:01000000:0.0:1788875168.483288:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a35955ea0 - data ffff9e5a2400a6c0/ffff9e5a03ed3c00 00000001:00000004:0.0:1788875168.497056:0:13081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:1.0:1788875168.526537:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788875168.589711:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788875168.589722:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788875168.589754:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788875168.589757:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788875168.592998:0:6899:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788875168.593007:0:6899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788875168.593021:0:6899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788875168.593937:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788875168.593949:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788875168.593961:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788875168.593964:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788875168.594670:0:7926:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788875168.594675:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788875168.594685:0:7926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788875168.686311:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f5b 00000020:00000080:1.0:1788875168.686325:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788875168.686461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788875168.691271:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f70 00000020:00000080:1.0:1788875168.691285:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788875168.691302:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788875168.691309:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875168.691318:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788875168.691323:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e5a362b8000) has no exports 00000004:01000000:1.0:1788875168.691485:0:13081:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788875168.691494:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821ae 00000020:00000080:1.0:1788875168.691499:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a04f4c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788875168.691503:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788875168.691507:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875168.691513:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788875168.691516:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e5a04933380) has no exports 00000020:00000080:1.0:1788875168.691523:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d821a7 00000020:00000080:1.0:1788875168.691527:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a3616d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788875168.691864:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788875168.691873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a04f4c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788875168.691878:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3616d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788875168.692220:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788875168.692225:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788875168.692243:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788875168.692249:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788875168.692251:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788875168.692339:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875168.692348:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788875168.692355:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d820c7 00000020:00000080:1.0:1788875168.692361:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a06246800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788875168.692449:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a36169800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788875168.692463:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5a3616e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788875168.692466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3616e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788875168.692472:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788875168.692635:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788875168.692639:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875168.692645:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788875168.692647:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e5a3c4819c0) has no exports 00000020:00000080:1.0:1788875168.692651:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d820c0 00000020:00000080:1.0:1788875168.692655:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a0495f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788875168.692679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06246800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788875168.693096:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788875168.693100:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788875168.693103:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788875168.693106:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788875168.693108:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788875168.693327:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0495f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788875168.693414:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875168.693421:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788875168.693453:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875168.693458:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788875168.693461:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a08639800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788875168.693464:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a08639800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788875168.693472:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788875168.693644:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f77 00000020:00000080:1.0:1788875168.693650:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c3000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788875168.693680:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a0495a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788875168.693686:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5a3f770000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788875168.693688:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3f770000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788875168.693692:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788875168.694138:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788875168.694228:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788875168.694242:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788875168.694248:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788875168.694251:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e5a362bb380) has no exports 00000020:00000080:0.0:1788875168.694272:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788875168.694277:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788875168.694280:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c6800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788875168.694282:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788875168.694286:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788875168.694431:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f7e 00000020:00000080:0.0:1788875168.694438:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c3800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788875168.694581:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a06641800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788875168.694585:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a06641800 3 00000020:01000004:0.0:1788875168.694588:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5a06641800 from lustre-MDT0000 00000020:00000080:0.0:1788875168.694608:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788875168.694612:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788875168.694615:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a362c0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788875168.694617:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788875168.694625:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788875168.694648:0:13081:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788875168.694652:0:13081:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788875168.694666:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788875168.694669:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788875168.694672:0:13081:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788875168.694679:0:13081:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e5a1894c000 372e367e-0deb-4060-9f2e-265b56425d5a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788875168.694684:0:13081:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e5a047299c0) has exports, disconnecting them 00000020:00080000:0.0:1788875168.694689:0:13081:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e5a1894c000), last request at 1788874932 00000020:00000080:0.0:1788875168.694704:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f15 00000020:00010000:0.0:1788875168.694709:0:13081:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5a1894c000: total 1 00000100:00080000:0.0:1788875168.694712:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9e5a18948000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788875168.694736:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5a1894c000): rc 0 00000020:00080000:0.0:1788875168.694740:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e5a047299c0) has no exports 00000020:00010000:3.0:1788875168.695011:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5a1894c000: total 1 00010000:00010000:3.0:1788875168.695040:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5a1894c000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788875168.695069:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a19c00/0x60858e6020d82272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8226b expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695085:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18400/0x60858e6020d8247f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82478 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695096:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a027ebc00/0x60858e6020d82034 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8202d expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695109:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a421c3600/0x60858e6020d8221e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82217 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695120:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a421c2a00/0x60858e6020d8222c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82225 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695131:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15400/0x60858e6020d82248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82241 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695141:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35a18000/0x60858e6020d8223a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d82233 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695152:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a00031800/0x60858e6020d82471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x60858e6020d8246a expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875168.695163:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5a1894c000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788875168.695201:0:5828:0:(genops.c:885:class_export_put()) final put ffff9e5a1894c000/372e367e-0deb-4060-9f2e-265b56425d5a 00000020:00000080:1.0:1788875168.695248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788875168.695378:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.695388:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875168.695390:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875168.695424:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e5a38ffd800:5834] 1 exiting: rc = 0 00000100:00100000:2.0:1788875168.695510:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e5a13a90800:5835] 2 exiting: rc = 0 00000020:00000080:1.0:1788875168.695523:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a1894c000/372e367e-0deb-4060-9f2e-265b56425d5a for MGS 00000100:00100000:2.0:1788875168.695592:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e5a03f5dc00:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1788875168.695672:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695681:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695689:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695695:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695701:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695706:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695712:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695718:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695724:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695729:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695735:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695740:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695745:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695751:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695758:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695765:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695788:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695809:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695817:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695822:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695828:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.695835:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696220:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696233:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696240:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696248:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696255:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696262:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696270:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696277:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696284:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696290:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696296:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696301:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696307:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696312:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696317:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696322:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696327:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696332:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696338:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696343:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696349:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696355:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696360:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696366:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696370:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696375:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696380:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696385:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696390:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696395:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696400:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696404:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696409:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696414:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696418:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696433:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696439:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696444:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696452:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696459:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696465:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.696472:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788875168.697221:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a18948000 for MGS 20000000:01000000:1.0:1788875168.699266:0:13081:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788875168.699272:0:13081:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788875168.700374:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a3c50d720 - data ffff9e5a3fe98948/ffff9e5a3c50bc00 00000020:01000000:1.0:1788875168.700500:0:13081:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a1930aba0 - data ffff9e5a2c3dd000/ffff9e5a0630f400 00000020:00000080:1.0:1788875168.702502:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f00 00000020:00000080:1.0:1788875168.702519:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a0362b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788875168.702540:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a06641800 from MGS, refs=2 00000020:01000004:1.0:1788875168.702544:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a06641800 2 00000020:01000004:1.0:1788875168.702548:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5a06641800 from MGS 00000020:00000080:1.0:1788875168.702576:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875168.702583:0:13081:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788875168.702586:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a0362c800/MGS 00000020:00000080:1.0:1788875168.702588:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0362c800/MGS for MGS 00000020:01000000:1.0:1788875168.702597:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788875168.702652:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788875168.702656:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875168.702660:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788875168.702667:0:13081:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e5a34e83800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788875168.702674:0:13081:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e5a06238000) has exports, disconnecting them 00000020:00080000:1.0:1788875168.702678:0:13081:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e5a34e83800), last request at 1788874933 00000020:00000080:1.0:1788875168.702683:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81fcb 00000020:00080000:1.0:1788875168.702695:0:13081:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5a34e83800): rc 0 00000020:00000080:1.0:1788875168.702699:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a34e83800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788875168.703223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0362b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788875168.703233:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a34e83800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788875168.707151:0:13081:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788875168.707173:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788875168.707178:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788875168.707185:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788875168.707217:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a1811c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788875168.707384:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788875168.707393:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788875168.707399:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a3c5bb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788875168.707402:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3c5bb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788875168.707407:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788875168.707465:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a06641800 1 00000020:00000080:3.0:1788875168.707472:0:13081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81ef2 00000020:00000080:3.0:1788875168.707478:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a0362b000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788875168.707487:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788875168.707495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0362b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788875168.707505:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875168.707509:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788875168.707512:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e5a0623b380) has no exports 00000020:00000080:3.0:1788875168.757279:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788875168.757296:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788875168.757302:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a06647800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788875168.757306:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06647800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788875168.757312:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788875168.757472:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5a06642800 00000020:01000000:3.0:1788875168.757493:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788875168.757506:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875168.757511:0:13081:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788875168.757515:0:13081:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e5a04934d40) has no exports 00000100:00100000:3.0:1788875168.757597:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e5a0497e000:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788875168.757737:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e5a03dce200:5843] 2 exiting: rc = 0 00000100:00100000:1.0:1788875168.757839:0:11390:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e5a0494b000:11390] 4 exiting: rc = 0 00000100:00100000:2.0:1788875168.758083:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e5a04e46600:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1788875168.760861:0:8216:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e5a109f7a00:8216] 3 exiting: rc = 0 00000100:00100000:3.0:1788875168.761711:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761726:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761732:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761737:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761742:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761747:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761752:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761757:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761762:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761767:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761933:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761942:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761951:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761959:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761967:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761974:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761982:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761989:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.761999:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762010:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762020:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762026:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762031:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762035:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762040:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762045:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762051:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762056:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762062:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762067:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762072:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762089:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762094:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762100:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762105:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762110:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762115:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762121:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762127:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762132:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762138:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762143:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762149:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762154:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762160:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762200:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762208:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762214:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762219:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762225:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762232:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762242:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762247:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762252:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762258:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762264:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762270:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762276:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762282:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762288:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762294:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762299:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762304:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.762309:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.766048:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e5a03df2600:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788875168.766227:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e5a03dce000:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788875168.766343:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766351:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766369:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766375:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766380:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766386:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766391:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766398:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766403:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766409:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766415:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766421:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766428:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766433:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766438:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766444:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766450:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766455:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766460:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766467:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766472:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766477:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766483:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766488:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766492:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766497:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766504:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766508:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766513:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766517:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766522:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766526:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766531:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766536:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766542:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766547:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766552:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766564:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766570:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766575:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766579:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766584:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766590:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766595:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766601:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766606:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766611:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766616:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766621:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766626:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766631:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766636:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766641:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766646:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766651:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766656:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766661:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766667:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766671:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766676:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766681:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766687:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766692:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.766698:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.767298:0:11970:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e5a04e37e00:11970] 2 exiting: rc = 0 00000100:00100000:1.0:1788875168.767399:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e5a04954400:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788875168.767466:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e5a04954200:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1788875168.767608:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767665:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767680:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767689:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767698:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767720:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767730:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767737:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767750:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767755:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767761:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767766:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767828:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767834:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767838:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767842:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767906:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767933:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767941:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767946:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767952:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767959:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767964:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767970:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767975:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767982:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767989:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.767998:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768007:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768040:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768051:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768057:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768061:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768065:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768070:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768074:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768078:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768082:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768086:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768093:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768098:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768112:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768120:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768190:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768199:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768208:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768216:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768221:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768230:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768239:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768248:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768257:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768268:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768289:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768297:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768303:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768308:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768314:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768321:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768328:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768334:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768339:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768348:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.768368:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.780297:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e5a04954c00:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1788875168.780477:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e5a04955600:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1788875168.780605:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780614:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780621:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780629:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780636:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780643:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780651:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780656:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780664:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780671:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780678:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780683:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780689:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780694:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780701:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780707:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780716:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780723:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780727:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780732:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780737:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780741:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.780746:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782589:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782607:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782612:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782628:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782633:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782637:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782642:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782647:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782652:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782658:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782663:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782668:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782674:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782679:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782684:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782689:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782694:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782699:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782704:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782709:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782714:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782719:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782724:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782729:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782733:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782737:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782743:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782748:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782752:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782757:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782762:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782767:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782828:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782834:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782838:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782843:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782907:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782912:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782923:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782928:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.782933:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875168.783492:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e5a0494aa00:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788875168.783678:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e5a0494b400:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788875168.783735:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783741:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783747:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783752:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783757:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783762:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783767:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783923:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783931:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783937:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783942:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783947:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783952:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783957:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783962:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783968:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783975:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783981:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783986:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783990:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783994:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.783999:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784004:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784009:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784014:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784019:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784023:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784028:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784031:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784036:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784040:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784054:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784059:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784064:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784070:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784076:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784081:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784086:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784090:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784094:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784099:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784104:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784108:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784113:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784118:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784123:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784128:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784133:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784138:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784143:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784148:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784154:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784159:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784223:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784230:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784235:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784239:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784243:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784248:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784252:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784257:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784261:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784266:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.784270:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.784673:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e5a0494de00:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1788875168.784765:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e5a0494d200:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1788875168.785328:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785334:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785350:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785355:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785359:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785364:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785368:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785373:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785377:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785382:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785387:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785391:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785396:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785401:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785406:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785411:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785416:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785420:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785425:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785430:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785434:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785439:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785444:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785449:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785454:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785459:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785464:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785469:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785475:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785480:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785484:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785488:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785493:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785498:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785503:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785508:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785513:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785525:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785530:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785535:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785540:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785545:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785550:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785555:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785560:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785564:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785569:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785574:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785579:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785583:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785587:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785592:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785598:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785602:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785607:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785611:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785617:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785622:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785627:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785631:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785636:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785640:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785645:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788875168.785650:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788875168.786435:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e5a0494d400:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788875168.786603:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e5a0494a400:5856] 2 exiting: rc = 0 00000100:00100000:1.0:1788875168.787428:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e5a04955a00:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1788875168.787548:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787555:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787560:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787567:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787572:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787578:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787584:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787590:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787595:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787601:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787607:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787616:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787622:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787627:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787632:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787638:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787647:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787653:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787658:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787664:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787670:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787675:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787681:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787687:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787693:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787699:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787705:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787728:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787735:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787740:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787745:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787762:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787768:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787789:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787795:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787801:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787806:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787812:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787817:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787822:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787827:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787832:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787838:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787843:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787864:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787871:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787877:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787882:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787887:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787893:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787898:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787918:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787926:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787931:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787936:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787941:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787946:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787952:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787957:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787964:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787969:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787974:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787979:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875168.787985:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788875168.793986:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788875168.794002:0:13081:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788875168.794021:0:13081:0:(genops.c:885:class_export_put()) final put ffff9e5a08639000/MDS_uuid 00000020:00000080:2.0:1788875168.794026:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a08639000/MDS_uuid for MDS 00000020:01000000:2.0:1788875168.794033:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788875168.794156:0:13081:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788875169.549986:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875170.574596:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788875170.671742:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788875170.671753:0:7652:0:(genops.c:885:class_export_put()) final put ffff9e5904e8b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788875170.672094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904e8b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788875170.672159:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5904e8b800 for lustre-OST0001 00010000:00010000:0.0:1788875171.601033:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788875172.515632:0:13233:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788875172.542016:0:13233:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788875172.542083:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875172.542103:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875172.542146:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875172.542156:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875172.542181:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788875172.542188:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788875172.542223:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788875172.542229:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788875172.542236:0:13233:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788875172.542285:0:13233:0:(import.c:65:import_set_state_nolock()) ffff9e5904e8f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788875172.542379:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875172.542388:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875172.542397:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14a00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875172.542401:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875172.542419:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875172.542426:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875172.542432:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875172.542435:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788875172.542438:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788875172.542471:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875172.542478:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875172.542520:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875172.542528:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d82233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x60858e6020d8223a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875172.542543:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875172.542545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875172.542547:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875172.542592:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875172.542617:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241091712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875172.542734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875172.542896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241091712 00000100:00100000:3.0:1788875172.542906:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241091712 00000100:00100000:3.0:1788875172.542964:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788875172.542974:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a05657850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1875771241091712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788875172.542981:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788875172 with bad export cookie 6955121743062638357 00000100:00100000:1.0:1788875172.545307:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241091584:0@lo:39:umount.0 00000400:00000100:1.0:1788875172.545391:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875771241091584 offset 0 length 224: 4 00000100:00100000:2.0:1788875172.556332:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a05657850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1875771241091712:12345-0@lo:103:ldlm_bl.0 Request processed in 13342us (13582us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788875172.556351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788875172.557487:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.107@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788875172.557495:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e5a0489e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788875172.557500:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.107@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788875172.568351:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.107@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788875172.568360:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788875172.568374:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5a3cd88a80 x1875771241091712/t0(0) o103->MGC192.168.202.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788875188 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788875172.568393:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788875172.568396:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788875172.568397:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788875172.568402:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e5a0489e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788875172.568408:0:3305:0:(import.c:545:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:1.0:1788875172.568419:0:3305:0:(import.c:665:import_select_connection()) MGC192.168.202.107@tcp: import ffff9e5a0489e000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875172.568586:0:3305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288e00 x1875771241091840/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788875172.568659:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241091840:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788875172.568738:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771241091840 offset 0 length 520: 4 00000100:00100000:0.0:1788875172.569381:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:372e367e-0deb-4060-9f2e-265b56425d5a:3305:1875771241091712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875172.622021:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875172.686690:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241091968:0@lo:400:kworker.0 00000400:00000100:1.0:1788875172.686792:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875771241091968 offset 0 length 224: 4 00000001:00100000:0.0:1788875172.764959:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788875172.764969:0:6720:0:(genops.c:885:class_export_put()) final put ffff9e5904edd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788875172.765005:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904edd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788875172.765064:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5904ede800 for lustre-OST0000 00010000:00010000:1.0:1788875173.646255:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875174.671195:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875175.694444:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875176.718433:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875177.742106:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788875177.806883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788875177.806924:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788875177.807034:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241092096:0@lo:400:kworker.0 00000400:00000100:2.0:1788875177.807127:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875771241092096 offset 0 length 224: 4 00010000:00010000:0.0:1788875178.766098:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875179.790255:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875180.814106:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875181.837998:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875182.862333:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788875182.926281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788875182.926294:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788875182.926403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788875182.926430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241092224:0@lo:400:kworker.0 00000400:00000100:3.0:1788875182.926517:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875771241092224 offset 0 length 224: 4 00000100:00100000:0.0:1788875182.929567:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875172/real 1788875172] req@ffff9e5a36288e00 x1875771241091840/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788875182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875182.929603:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a36288e00 x1875771241091840/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788875182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875182.929635:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875172/real 1788875172] req@ffff9e5a36288700 x1875771241091584/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788875182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875182.929650:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a36288700 x1875771241091584/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788875182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788875182.929671:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0489e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788875182.931395:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788875182.931409:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241091840:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788875182.931425:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5904e8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788875182.931450:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241091584:0@lo:39:umount.0 00000100:00080000:0.0:1788875182.931516:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788875182.931523:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788875182.931529:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788875182.935649:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.935684:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.935693:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.935702:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.935743:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875182.936228:0:13233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.936239:0:13233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.936246:0:13233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.936252:0:13233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875182.936285:0:13233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788875182.936291:0:13233:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788875182.936334:0:13233:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788875182.936340:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788875182.936347:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788875182.936354:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788875182.936360:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e5a04728000) has no exports 00000020:00080000:0.0:1788875182.936397:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e5a04728000) has no exports 00010000:00010000:2.0:1788875182.937240:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875182.937256:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937266:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875182.937270:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937281:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875182.937290:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875182.937321:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788875182.937324:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788875182.937327:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788875182.937347:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:2.0:1788875182.937351:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937358:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19e00/0x60858e6020d82241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82248 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937378:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875182.937382:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937388:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19800 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875182.937391:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937398:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875182.937405:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875182.937411:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788875182.937413:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788875182.937415:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788875182.937418:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:2.0:1788875182.937421:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937432:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19800/0x60858e6020d82478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8247f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875182.937441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875182.937443:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875182.937445:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875182.937869:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788875182.940041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788875182.940055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788875182.940060:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5a0489e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788875182.940070:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 387 00000100:00080000:1.0:1788875182.940079:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.107@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788875182.940087:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.107@tcp: import ffff9e5a0489e000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1788875182.940144:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a355e2a00 x1875771241092352/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788875182.940815:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241092352:0@lo:250:kworker.0 00000400:00000100:2.0:1788875182.940891:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771241092352 offset 0 length 520: 4 00000020:01000000:0.0:1788875182.944381:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a35955b40 - data ffff9e5a240216c0/ffff9e5904d8b000 00000020:01000000:0.0:1788875182.944531:0:13233:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a056d35a0 - data ffff9e5a24237bd0/ffff9e5905713800 00100000:10000000:1.0:1788875182.971421:0:13233:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788875183.024987:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d82050 00000020:00000080:2.0:1788875183.025007:0:13233:0:(genops.c:885:class_export_put()) final put ffff9e5a3f777800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788875183.025100:0:13233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a07881000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788875183.025105:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a07881000 2 00000020:01000004:2.0:1788875183.025109:0:13233:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5a07881000 from lustre-OST0000 00000020:00000080:2.0:1788875183.025151:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788875183.025164:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788875183.025167:0:13233:0:(genops.c:885:class_export_put()) final put ffff9e5a3f773000/lustre-OST0000_UUID 00000020:00000080:2.0:1788875183.025170:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3f773000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788875183.025189:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788875183.025265:0:13233:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788875183.025271:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788875183.025276:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788875183.025856:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788875183.025867:0:13233:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e5904e88800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788875183.025875:0:13233:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9e5a362bcd40) has exports, disconnecting them 00000020:00080000:2.0:1788875183.025882:0:13233:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e5904e88800), last request at 1788874952 00000020:00000080:2.0:1788875183.025888:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d8207a 00000020:00080000:2.0:1788875183.025925:0:13233:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5904e88800): rc 0 00000020:00000080:2.0:1788875183.025932:0:13233:0:(genops.c:885:class_export_put()) final put ffff9e5904e88800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788875183.027655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3f777800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788875183.032005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904e88800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788875183.032510:0:13233:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788875183.032517:0:13233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788875183.032523:0:13233:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788875183.032530:0:13233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788875183.032754:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788875183.032796:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788875183.032804:0:13233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a07881000 1 00000020:00000080:3.0:1788875183.032813:0:13233:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d8200a 00000020:00000080:3.0:1788875183.032824:0:13233:0:(genops.c:885:class_export_put()) final put ffff9e5a362c2000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788875183.032829:0:13233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788875183.032836:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875183.032841:0:13233:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788875183.032846:0:13233:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e5a04930000) has no exports 00000020:00000080:1.0:1788875183.033840:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5904e8f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788875183.033856:0:36:0:(genops.c:885:class_export_put()) final put ffff9e5904e8d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788875183.033860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904e8d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788875183.033870:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788875183.033954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788875183.062992:0:13233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875183.063017:0:13233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788875183.063025:0:13233:0:(genops.c:885:class_export_put()) final put ffff9e5a07886800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788875183.063043:0:13233:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a07886800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788875183.063056:0:13233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788875183.064010:0:13233:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5a07884000 00000020:02000400:1.0:1788875183.064121:0:13233:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788875183.898586:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875184.913475:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875185.943312:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788875186.221573:0:13390:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788875186.232735:0:13390:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788875186.232935:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875186.232954:0:13390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875186.232963:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875186.232993:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875186.233638:0:13390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788875186.233649:0:13390:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788875186.233686:0:13390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788875186.233701:0:13390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5a3fd48700 x1875771241091968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788875186.233962:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875186.233972:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875186.233980:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875186.233985:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875186.233996:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875186.234017:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875186.234039:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875186.234041:0:7640:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788875186.234045:0:7640:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788875186.234060:0:7640:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:3.0:1788875186.234064:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875186.234072:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15e00/0x60858e6020d82217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8221e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875186.234086:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875186.234088:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875186.234090:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875186.234245:0:13390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5a355e0000 x1875771241092096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875186.234266:0:13390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5a355e3100 x1875771241092224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875186.234281:0:13390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788875186.234289:0:13390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788875186.234314:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241092224:0@lo:400:kworker.0 00000100:00080000:2.0:1788875186.234318:0:13390:0:(import.c:65:import_set_state_nolock()) ffff9e5a3616c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788875186.234356:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875771241092096:0@lo:400:kworker.0 00000100:00100000:0.0:1788875186.234432:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875771241091968:0@lo:400:kworker.0 00000100:00100000:2.0:1788875186.234502:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241092480:0@lo:39:umount.0 00000400:00000100:2.0:1788875186.234563:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875771241092480 offset 0 length 224: 4 00010000:00010000:1.0:1788875186.957922:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875187.982328:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788875188.046178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788875188.046189:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788875189.008136:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875190.030790:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875191.054620:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875192.078017:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875193.103471:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788875193.167335:0:13355:0:(pinger.c:229:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788875193.167347:0:13355:0:(pinger.c:247:ptlrpc_pinger_process_import()) 372e367e-0deb-4060-9f2e-265b56425d5a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788875194.126114:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875195.149947:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875196.181018:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875196.498621:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875186/real 1788875186] req@ffff9e5a3fd4bb80 x1875771241092480/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788875196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875196.498656:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a3fd4bb80 x1875771241092480/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788875196 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788875196.498676:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a3616c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788875196.498725:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241092480:0@lo:39:umount.0 00000100:00080000:0.0:1788875196.498805:0:13390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788875196.498810:0:13390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788875196.498815:0:13390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788875196.503900:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.503933:0:13390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.503941:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.503949:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.503980:0:13390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875196.503988:0:13390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.503995:0:13390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.504001:0:13390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.504023:0:13390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875196.504053:0:13390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788875196.504058:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1788875196.504059:0:13390:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1788875196.504069:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504079:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19200 already unused, calling callback (ffffffffc1d58c20) 00000020:01000004:0.0:1788875196.504083:0:13390:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 10000000:00010000:3.0:1788875196.504084:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788875196.504090:0:13390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788875196.504097:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788875196.504098:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788875196.504103:0:13390:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788875196.504110:0:13390:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e5a35d03380) has no exports 10000000:00010000:3.0:1788875196.504123:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875196.504130:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875196.504133:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788875196.504136:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:0.0:1788875196.504140:0:13390:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e5a35d03380) has no exports 00010000:00010000:3.0:1788875196.504152:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:3.0:1788875196.504157:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504164:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19200/0x60858e6020d82225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d8222c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504179:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875196.504183:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504189:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19a00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875196.504192:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504199:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875196.504204:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875196.504209:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788875196.504211:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788875196.504218:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788875196.504225:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:3.0:1788875196.504228:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504234:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19a00/0x60858e6020d8246a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82471 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.504247:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875196.504250:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875196.504252:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875196.506757:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788875196.517295:0:13390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a35e0eea0 - data ffff9e5a243a5948/ffff9e5a3c520c00 00000020:01000000:0.0:1788875196.517511:0:13390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5a35955ba0 - data ffff9e5a3fe67a20/ffff9e5a3c525c00 00100000:10000000:0.0:1788875196.529975:0:13390:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788875196.599855:0:13390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d8211b 00000020:00000080:3.0:1788875196.599867:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a3f773800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788875196.599883:0:13390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5904e88000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788875196.599887:0:13390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5904e88000 2 00000020:01000004:3.0:1788875196.599890:0:13390:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5904e88000 from lustre-OST0001 00000020:00000080:3.0:1788875196.599935:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788875196.599945:0:13390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788875196.599949:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a0495b800/lustre-OST0001_UUID 00000020:00000080:3.0:1788875196.599952:0:13390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0495b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788875196.599959:0:13390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788875196.600098:0:13390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 372e367e-0deb-4060-9f2e-265b56425d5a->MGS 00010000:00010000:3.0:1788875196.600114:0:13390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875196.600125:0:13390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875196.600132:0:13390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788875196.600134:0:13390:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788875196.600138:0:13390:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788875196.600151:0:13390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:3.0:1788875196.600164:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b27000/0x60858e6020d8202d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82034 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875196.600181:0:13390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875196.600187:0:13390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875196.600192:0:13390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788875196.600194:0:13390:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788875196.600196:0:13390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788875196.600206:0:13390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5a0489e000 00010000:00010000:3.0:1788875196.600209:0:13390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13b26e00/0x60858e6020d8226b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x60858e6020d82272 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788875196.600225:0:13390:0:(import.c:65:import_set_state_nolock()) ffff9e5a0489e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788875196.600229:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788875196.600231:0:13390:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788875196.600233:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788875196.600237:0:13390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788875196.600247:0:13390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5a355e2a00 x1875771241092352/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788875197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788875196.600262:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788875196.600265:0:13390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1788875196.600356:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:372e367e-0deb-4060-9f2e-265b56425d5a:3302:1875771241092352:0@lo:250:kworker.0 10000000:01000000:3.0:1788875196.600713:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788875196.600721:0:13390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d81f0e 00000020:00000080:3.0:1788875196.600727:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a0863e000/372e367e-0deb-4060-9f2e-265b56425d5a 00000020:01000000:3.0:1788875196.600733:0:13390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.107@tcp (flags='') 00000020:00000080:3.0:1788875196.600739:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875196.600744:0:13390:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.107@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788875196.600748:0:13390:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e5a0472b380) has no exports 00000020:00000080:1.0:1788875196.600855:0:13355:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3f773800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788875196.600868:0:13355:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0863e000/372e367e-0deb-4060-9f2e-265b56425d5a for MGC192.168.202.107@tcp 10000000:01000000:2.0:1788875196.600931:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788875196.601015:0:13390:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.107@tcp: client import never connected 00000100:00080000:3.0:1788875196.601018:0:13390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788875196.601021:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788875196.601023:0:13390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788875196.601025:0:13390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788875196.601095:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788875196.601100:0:13390:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.107@tcp (uuid 372e367e-0deb-4060-9f2e-265b56425d5a) 00000020:01000000:3.0:1788875196.601106:0:13390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788875196.601109:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788875196.601112:0:13390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788875196.601116:0:13390:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e5a3616b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788875196.601122:0:13390:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9e5a049319c0) has exports, disconnecting them 00000020:00080000:3.0:1788875196.601126:0:13390:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e5a3616b800), last request at 1788874972 00000020:00000080:3.0:1788875196.601130:0:13390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d82145 00000020:00080000:3.0:1788875196.601141:0:13390:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5a3616b800): rc 0 00000020:00000080:3.0:1788875196.601144:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a3616b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788875196.605138:0:13355:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a0489e000 for MGC192.168.202.107@tcp 00000020:00000080:1.0:1788875196.605160:0:13355:0:(genops.c:885:class_export_put()) final put ffff9e5a0489a800/372e367e-0deb-4060-9f2e-265b56425d5a 00000020:00000080:1.0:1788875196.605164:0:13355:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a0489a800/372e367e-0deb-4060-9f2e-265b56425d5a for MGC192.168.202.107@tcp 00000020:01000000:1.0:1788875196.605173:0:13355:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.107@tcp (372e367e-0deb-4060-9f2e-265b56425d5a) 00000020:00000080:1.0:1788875196.610313:0:13355:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3616b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788875196.617863:0:13390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788875196.617873:0:13390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788875196.617877:0:13390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788875196.617884:0:13390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788875196.618624:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788875196.618749:0:13355:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5a3616c000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788875196.619490:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788875196.621633:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788875196.621927:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788875196.622099:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e5a04e43200:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1788875196.622265:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e5a029ece00:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1788875196.622369:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875196.622667:0:8459:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e5a3f7f1200:8459] 3 exiting: rc = 0 00000100:00100000:2.0:1788875196.622730:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e5a029ed800:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1788875196.622986:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e5a029eda00:5827] 2 exiting: rc = 0 00000100:00100000:2.0:1788875196.625574:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e5a029ed600:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1788875196.625817:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625825:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625833:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625840:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625846:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625852:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625858:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625881:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625887:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625892:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625898:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625916:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625922:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625927:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625933:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625940:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625946:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625951:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625956:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625961:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625965:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625970:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625974:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625979:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625984:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625988:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625993:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.625997:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626002:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626007:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626011:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626016:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626021:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626025:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626030:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626035:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626040:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626044:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626049:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626054:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626059:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626063:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626080:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626085:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626090:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626095:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626099:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626105:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626112:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626117:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626122:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626126:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626131:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626135:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626139:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626144:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626148:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626154:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626159:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626164:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626168:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626173:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626178:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.626183:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788875196.628635:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875196.628649:0:13390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788875196.628655:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a3616f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788875196.628661:0:13390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a3616f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788875196.628672:0:13390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788875196.628723:0:13390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5904e88000 1 00000020:00000080:1.0:1788875196.628729:0:13390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x60858e6020d820ea 00000020:00000080:1.0:1788875196.628736:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a06240800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788875196.628754:0:13390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788875196.628767:0:13355:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a06240800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788875196.628799:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875196.628814:0:13390:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788875196.628818:0:13390:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e5a062399c0) has no exports 00000020:00000080:1.0:1788875196.668810:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875196.668828:0:13390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788875196.668835:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5904e8a000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788875196.668840:0:13390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5904e8a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788875196.668853:0:13390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788875196.669051:0:13390:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5904e8c800 00000020:01000000:1.0:1788875196.669075:0:13390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788875196.669079:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788875196.669084:0:13390:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788875196.669088:0:13390:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e5a0472cd40) has no exports 00000020:00000080:1.0:1788875196.669110:0:13390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788875196.669116:0:13390:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788875196.669119:0:13390:0:(genops.c:885:class_export_put()) final put ffff9e5a362c7000/OSS_uuid 00000020:00000080:1.0:1788875196.669121:0:13390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5a362c7000/OSS_uuid for OSS 00000020:01000000:1.0:1788875196.669128:0:13390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788875196.669918:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788875196.673924:0:6901:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e5904d20400:6901] 3 exiting: rc = 0 00000100:00100000:2.0:1788875196.674874:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e5a04f0de00:6697] 2 exiting: rc = 0 00000100:00100000:2.0:1788875196.674963:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e5a3c8f4c00:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1788875196.676892:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e5a3c8f5c00:6696] 1 exiting: rc = 0 00000100:00100000:1.0:1788875196.677083:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677096:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677105:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677113:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677119:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677125:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677131:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677135:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677141:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677146:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677151:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677156:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677162:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677167:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677174:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677196:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677203:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677209:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677214:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677220:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677225:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677231:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677237:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677242:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677248:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677254:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677259:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677265:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677270:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677287:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677295:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677300:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677306:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677312:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677318:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677323:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677329:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677426:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677445:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677450:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677455:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677460:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677466:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677473:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677478:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677484:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677488:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677505:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677512:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677517:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677531:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677536:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677541:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677546:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677552:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677558:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677563:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677568:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677574:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.677580:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.678173:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.678183:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.678188:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.678194:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875196.680507:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e5a0665a800:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1788875196.680813:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e5a38fd7400:6699] 1 exiting: rc = 0 00000100:00100000:1.0:1788875196.681101:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681110:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681116:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681121:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681126:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681131:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681136:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681141:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681146:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681151:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681156:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681161:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681166:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681172:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681177:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681183:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681189:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681194:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681199:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681204:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681209:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681227:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681232:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681238:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681243:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681248:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681253:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681259:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681264:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681269:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681275:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681283:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681289:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681294:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681299:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681305:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681310:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681316:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681322:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681329:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681416:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681422:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681428:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681451:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681457:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681462:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681468:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681473:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681479:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681484:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681489:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681656:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681665:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681671:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681677:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681682:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681693:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681699:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681704:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681710:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681715:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681720:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681725:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.681731:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875196.683449:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e5a04e36200:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1788875196.684080:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e5a029ed000:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1788875196.685285:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e5a04e36600:6702] 2 exiting: rc = 0 00000100:00100000:1.0:1788875196.685393:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685402:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685407:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685413:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685419:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685424:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685961:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685972:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.685978:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686006:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686013:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686018:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686027:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686032:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686037:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686042:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686047:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686053:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686058:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686063:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686068:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686073:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686079:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686084:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686089:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686095:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686114:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686119:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686124:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686131:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686137:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686142:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686148:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686167:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686173:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686180:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686186:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686191:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686197:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686204:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686209:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686215:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686221:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686226:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686232:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686238:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686243:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686249:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686255:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686261:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686267:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686273:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686279:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686285:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686291:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686297:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686304:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686310:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686316:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686322:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686388:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686402:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686408:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.686414:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.698911:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e5a064a8a00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1788875196.699115:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e5a064a9a00:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1788875196.702152:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702163:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702170:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702175:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702181:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702186:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702191:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702195:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702200:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702205:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702210:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702216:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702222:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702227:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702232:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702237:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702242:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702248:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702253:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702258:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702263:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702269:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702275:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702280:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702286:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702293:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702298:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702303:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702308:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702314:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702319:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702353:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702359:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702364:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702370:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702375:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702380:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702385:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702391:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702395:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702400:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702405:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702410:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702415:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702419:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702424:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702428:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702442:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702447:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702453:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702460:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702466:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702472:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702477:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702482:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702488:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702499:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702505:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702510:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702515:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702520:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702526:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702531:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.702536:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788875196.705098:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e5a3f74ae00:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1788875196.715880:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e5a18102200:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1788875196.716031:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716054:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716069:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716084:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716092:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716098:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716105:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716111:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716117:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716122:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716127:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716133:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716139:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716144:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716150:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716172:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716179:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716185:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716192:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716197:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716203:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716209:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716214:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716220:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716226:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716231:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716236:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716258:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716265:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716271:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716277:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716283:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716289:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716295:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716301:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716306:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716319:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716324:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716330:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716347:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716353:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716358:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716364:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716369:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716375:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716380:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716387:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716393:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716399:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716405:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.716411:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718006:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718022:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718028:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718035:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718042:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718047:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718053:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718059:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718071:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718078:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718084:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718092:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788875196.718102:0:13390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788875196.744610:0:13390:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788875218.786507:0:14008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788875230.625389:0:14470:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788875230.625394:0:14470:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788875230.625510:0:14470:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e59064ff800 00000020:01000004:1.0:1788875230.627387:0:14470:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788875230.627397:0:14470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788875230.627413:0:14470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e5a35d04d40) 00000020:00000080:1.0:1788875230.627427:0:14470:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788875230.685867:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788875230.691668:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788875230.695802:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:3.0:1788875230.696196:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788875230.696275:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 515: rc = 0 00100000:10000000:3.0:1788875230.696379:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:3.0:1788875230.696480:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:3.0:1788875230.696684:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 515: rc = 0 00100000:10000000:3.0:1788875230.696822:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:3.0:1788875230.697134:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 517: rc = 0 00100000:10000000:3.0:1788875230.705367:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 280: rc = 0 00100000:10000000:3.0:1788875230.705618:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 280: rc = 0 00100000:10000000:3.0:1788875230.706826:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.708507:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 768: rc = 0 00100000:10000000:3.0:1788875230.708842:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 768: rc = 0 00100000:10000000:3.0:1788875230.709596:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.710738:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788875230.711538:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.712136:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.712451:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 768: rc = 0 00100000:10000000:3.0:1788875230.712732:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788875230.715094:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.715729:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1788875230.716061:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 768: rc = 0 00100000:10000000:3.0:1788875230.717568:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 459: rc = 0 00100000:10000000:3.0:1788875230.721881:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 459: rc = 0 00100000:10000000:3.0:1788875230.726085:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 459: rc = 0 00100000:10000000:3.0:1788875230.726384:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 459: rc = 0 00100000:10000000:2.0:1788875230.727823:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 459: rc = 0 00100000:10000000:2.0:1788875230.728135:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 459: rc = 0 00100000:10000000:2.0:1788875230.728707:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 459: rc = 0 00100000:10000000:2.0:1788875230.729624:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 459: rc = 0 00100000:10000000:2.0:1788875230.730684:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 459: rc = 0 00100000:10000000:2.0:1788875230.730992:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 459: rc = 0 00100000:10000000:2.0:1788875230.737560:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 459: rc = 0 00100000:10000000:2.0:1788875230.740763:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 459: rc = 0 00100000:10000000:2.0:1788875230.741469:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 459: rc = 0 00100000:10000000:2.0:1788875230.741761:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 459: rc = 0 00100000:10000000:2.0:1788875230.746063:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 459: rc = 0 00100000:10000000:2.0:1788875230.747664:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 459: rc = 0 00100000:10000000:2.0:1788875230.748022:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 459: rc = 0 00100000:10000000:2.0:1788875230.751821:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 459: rc = 0 00100000:10000000:1.0:1788875230.754930:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 459: rc = 0 00100000:10000000:1.0:1788875230.755858:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 459: rc = 0 00100000:10000000:1.0:1788875230.756823:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 459: rc = 0 00100000:10000000:1.0:1788875230.757122:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 459: rc = 0 00100000:10000000:1.0:1788875230.757387:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 459: rc = 0 00100000:10000000:1.0:1788875230.759856:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 459: rc = 0 00100000:10000000:1.0:1788875230.760154:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 459: rc = 0 00100000:10000000:1.0:1788875230.760927:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 459: rc = 0 00100000:10000000:1.0:1788875230.762996:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 459: rc = 0 00100000:10000000:1.0:1788875230.763998:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 459: rc = 0 00100000:10000000:1.0:1788875230.769930:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 459: rc = 0 00100000:10000000:1.0:1788875230.774234:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 459: rc = 0 00100000:10000000:1.0:1788875230.776335:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 459: rc = 0 00100000:10000000:1.0:1788875230.777873:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 459: rc = 0 00100000:10000000:1.0:1788875230.778462:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 659: rc = 0 00100000:10000000:1.0:1788875230.779133:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788875230.779307:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 281: rc = 0 00100000:10000000:1.0:1788875230.785309:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788875230.785489:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 281: rc = 0 00100000:10000000:1.0:1788875230.786884:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788875230.786969:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 281: rc = 0 00100000:10000000:2.0:1788875230.798823:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788875230.798990:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 655: rc = 0 00100000:10000000:3.0:1788875230.808488:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788875230.809509:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 655: rc = 0 00100000:10000000:3.0:1788875230.810449:0:14470:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788875230.813868:0:14470:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 655: rc = 0 00000020:00000080:3.0:1788875230.819362:0:14470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788875230.819386:0:14470:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788875230.819399:0:14470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d8320f 00000020:01000004:3.0:1788875230.819407:0:14470:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788875230.819412:0:14470:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788875230.819418:0:14470:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e59064ff800 from MGS 00000020:01000004:3.0:1788875230.819423:0:14470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788875230.819436:0:14470:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e5a3c483380) 00000020:00000080:3.0:1788875230.819448:0:14470:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788875230.819511:0:14470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e59064ff800 from MGS, refs=2 00080000:01000000:3.0:1788875230.821481:0:14470:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788875230.821495:0:14470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d8321d 00000100:00100000:3.0:1788875230.821891:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788875230.822380:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788875230.822387:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788875230.826486:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788875230.826501:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788875230.828282:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788875230.828484:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788875230.828491:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788875230.834259:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788875230.834283:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788875230.835456:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788875230.835466:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788875230.836519:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.836530:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.836532:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.838504:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.838517:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.838520:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875230.857375:0:14470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788875230.868658:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788875230.880564:0:14470:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788875230.880595:0:14470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788875230.880598:0:14470:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788875230.891410:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788875230.893548:0:14470:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788875230.893664:0:14470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788875230.894146:0:14470:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788875230.894435:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788875230.894574:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788875230.913082:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788875230.913936:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788875230.913945:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788875230.918121:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788875230.918134:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788875230.921566:0:14470:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788875230.921601:0:14470:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.107@tcp' 00000020:01000004:2.0:1788875230.921603:0:14470:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788875230.921634:0:14470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.107@tcp (typ=mgc) 00000020:00000080:2.0:1788875230.921648:0:14470:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.107@tcp (ffff9e5a362bcd40) 00000020:00000080:2.0:1788875230.921662:0:14470:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788875230.921731:0:14470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a3d073000@MGC192.168.202.107@tcp: add connection 192.168.202.107@tcp at head 00010000:00010000:2.0:1788875230.922058:0:14470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.107@tcp-0 is initialized 00000040:01000000:2.0:1788875230.922066:0:14470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788875230.922997:0:14484:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788875230.946518:0:14485:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788875230.949559:0:14470:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.107@tcp (uuid 23009a34-c6dd-4af5-b962-084fb475da02) 00000020:00000080:1.0:1788875230.949595:0:14470:0:(genops.c:1385:class_connect()) connect: client 23009a34-c6dd-4af5-b962-084fb475da02, cookie 0x60858e6020d8322b 00000100:00080000:1.0:1788875230.949617:0:14470:0:(import.c:545:import_select_connection()) MGC192.168.202.107@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788875230.949624:0:14470:0:(import.c:665:import_select_connection()) MGC192.168.202.107@tcp: import ffff9e5a3d073000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1788875230.949656:0:14470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a355e1500 x1875771241092608/t0(0) o250->MGC192.168.202.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788875230.949690:0:14470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 23009a34-c6dd-4af5-b962-084fb475da02->MGS 00000020:01000004:1.0:1788875230.949710:0:14470:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788875230.949735:0:14470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788875230.949751:0:14470:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e5a35d00000) 00000020:00000080:1.0:1788875230.949764:0:14470:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788875230.950339:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23009a34-c6dd-4af5-b962-084fb475da02:3302:1875771241092608:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788875230.950411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875230.950539:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241092608 00000100:00100000:0.0:1788875230.950548:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241092608 00000100:00100000:0.0:1788875230.950597:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788875230.950605:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875771241092608:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788875230.950630:0:14481:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 23009a34-c6dd-4af5-b962-084fb475da02@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1788875230.950657:0:14481:0:(genops.c:1385:class_connect()) connect: client 23009a34-c6dd-4af5-b962-084fb475da02, cookie 0x60858e6020d83239 00000100:00080000:0.0:1788875230.950824:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9e5904edd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788875230.950881:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+5:3302:x1875771241092608:12345-0@lo:250:mount.lustre.0 Request processed in 275us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875230.950889:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875230.951017:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.107@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788875230.951026:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.107@tcp: connect to target with instance 0 00000100:00080000:3.0:1788875230.951033:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.107@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788875230.951038:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788875230.951042:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a3d073000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788875230.951045:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788875230.951051:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788875230.951056:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23009a34-c6dd-4af5-b962-084fb475da02:3302:1875771241092608:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788875230.978653:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788875230.978909:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788875230.978916:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788875230.990336:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788875230.990357:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788875230.992723:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788875230.992735:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788875231.000485:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788875231.004697:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788875231.004709:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788875231.019377:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788875231.019394:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788875231.058128:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788875231.058342:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788875231.058349:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788875231.059504:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788875231.059513:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788875231.060289:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788875231.060466:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788875231.060472:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788875231.061097:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788875231.061105:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788875231.062220:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788875231.062384:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788875231.062390:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788875231.063064:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788875231.063072:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788875231.063656:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788875231.063995:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788875231.064002:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788875231.064427:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788875231.064434:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788875231.092696:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788875231.093173:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788875231.093181:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788875231.094762:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788875231.095064:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788875231.096638:0:14470:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788875231.096650:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788875231.097495:0:14470:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788875231.097518:0:14470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788875231.097525:0:14470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788875231.097682:0:14470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788875231.097714:0:14470:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788875231.097719:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788875231.097720:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788875231.097722:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875231.097723:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875231.097724:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875231.097725:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875231.097727:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788875231.097728:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788875231.097730:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875231.097731:0:14470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875231.097734:0:14470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788875231.097736:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788875231.097743:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788875231.097743:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875231.097744:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875231.097745:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875231.097746:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875231.097747:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788875231.097748:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788875231.097749:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875231.097750:0:14470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875231.097810:0:14470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788875231.097832:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788875231.099106:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.099167:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.099340:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241092736 00000100:00100000:3.0:1788875231.099348:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241092736 00000100:00100000:3.0:1788875231.099388:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875231.099397:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+5:14470:x1875771241092736:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788875231.099442:0:14483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788875231.099446:0:14483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788875231.099449:0:14483:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788875231.100310:0:14504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788875231.100828:0:14483:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788875231.102673:0:14505:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788875231.102679:0:14505:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788875231.102681:0:14505:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788875231.102711:0:14505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788875231.103200:0:14483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788875231.103212:0:14483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788875231.113795:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+5:14470:x1875771241092736:12345-0@lo:253:mount.lustre.0 Request processed in 14371us (14664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.113815:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875231.114402:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788875231.114420:0:14470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788875231.114423:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788875231.114424:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788875231.114426:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875231.114427:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875231.114428:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875231.114429:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875231.114430:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788875231.114431:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788875231.114433:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875231.114435:0:14470:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788875231.114455:0:14470:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e59064ff800 from lustre-MDT0000 10000000:01000000:3.0:1788875231.114481:0:14470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788875231.114484:0:14470:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788875231.114489:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e5a362bcd40 10000000:01000000:3.0:1788875231.114493:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788875231.114502:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e5a362bcd40 from 1 10000000:01000000:3.0:1788875231.114519:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788875231.114561:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.114573:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.114593:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.114612:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788875231.114656:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.114691:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a05778180 going to sleep for 11 seconds 00000100:00100000:0.0:1788875231.115151:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241092864 00000100:00100000:0.0:1788875231.115160:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241092864 00000100:00100000:0.0:1788875231.115202:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788875231.115211:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+5:14470:x1875771241092864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788875231.115223:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875231.115236:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0c00/0x60858e6020d83247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83240 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875231.115267:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0c00/0x60858e6020d83247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83240 expref: 6 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875231.115277:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0c00/0x60858e6020d83247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83240 expref: 6 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875231.115286:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0c00, rc 0) 00000100:00100000:0.0:1788875231.115330:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+6:14470:x1875771241092864:12345-0@lo:101:mount.lustre.0 Request processed in 121us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875231.115337:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788875231.115465:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875231.115479:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.115488:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.115541:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.115564:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.115599:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.115661:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241092992 00000100:00100000:3.0:1788875231.115665:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241092992 00000100:00100000:3.0:1788875231.115696:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875231.115703:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+6:14470:x1875771241092992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875231.116092:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+6:14470:x1875771241092992:12345-0@lo:501:mount.lustre.0 Request processed in 388us (525us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788875231.116099:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788875231.116652:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241092992:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788875231.116690:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788875231.116753:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.116764:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875231.116793:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e59064ff800 10000000:01000000:2.0:1788875231.116798:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788875231.116802:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e59064ff800 10000000:01000000:2.0:1788875231.116804:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788875231.116808:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e59064ff800 from 1 10000000:01000000:2.0:1788875231.116810:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788875231.116839:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.116846:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.116854:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.116870:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875231.116913:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.116942:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.117028:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093120 00000100:00100000:3.0:1788875231.117034:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093120 00000100:00100000:3.0:1788875231.117071:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788875231.117079:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+6:14470:x1875771241093120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875231.117090:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875231.117103:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d83255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8324e expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.117120:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d83255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8324e expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.117137:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15e00/0x60858e6020d83255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8324e expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.117144:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15e00, rc 0) 00000100:00100000:3.0:1788875231.117181:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+7:14470:x1875771241093120:12345-0@lo:101:mount.lustre.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.117187:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788875231.117549:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875231.117561:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83255 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.117568:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83255 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875231.117596:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788875231.117694:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83255 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.117700:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44400/0x60858e6020d8324e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83255 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875231.117706:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788875231.117710:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788875231.117715:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e59064ff800 10000000:01000000:2.0:1788875231.117717:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788875231.117720:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788875231.117722:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788875231.117738:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.117744:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.117750:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.117761:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875231.117812:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.117835:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.117900:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093248 00000100:00100000:1.0:1788875231.117905:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093248 00000100:00100000:1.0:1788875231.117930:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788875231.117936:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+7:14470:x1875771241093248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875231.117943:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875231.117951:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35b34800/0x60858e6020d83263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8325c expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.117974:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35b34800/0x60858e6020d83263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8325c expref: 8 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.117981:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35b34800/0x60858e6020d83263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8325c expref: 8 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.117987:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34800, rc 0) 00000100:00100000:1.0:1788875231.118031:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+8:14470:x1875771241093248:12345-0@lo:101:mount.lustre.0 Request processed in 95us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.118036:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788875231.118170:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875231.118181:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83263 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.118194:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83263 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.118241:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.118281:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.118304:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.118444:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093376 00000100:00100000:1.0:1788875231.118448:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093376 00000100:00100000:1.0:1788875231.118480:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875231.118487:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+8:14470:x1875771241093376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875231.118902:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+9:14470:x1875771241093376:12345-0@lo:501:mount.lustre.0 Request processed in 414us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.118908:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788875231.119165:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.119197:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875231.119243:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.119401:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.119446:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093504 00000100:00100000:1.0:1788875231.119451:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093504 00000100:00100000:1.0:1788875231.119485:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788875231.119492:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+9:14470:x1875771241093504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788875231.119837:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+9:14470:x1875771241093504:12345-0@lo:503:mount.lustre.0 Request processed in 343us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.119844:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788875231.120109:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241093504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875231.120643:0:14506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14506:1875771241093632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875231.120686:0:14506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.120713:0:14506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a03eeb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.120754:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093632 00000100:00100000:1.0:1788875231.120759:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093632 00000100:00100000:1.0:1788875231.120975:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788875231.120984:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+9:14506:x1875771241093632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875231.121267:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+9:14506:x1875771241093632:12345-0@lo:502:llog_process_th.0 Request processed in 277us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.121273:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788875231.121596:0:14506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14506:1875771241093632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788875231.121629:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788875231.121640:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875231.121643:0:14506:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788875231.121649:0:14506:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788875231.121651:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788875231.121666:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e5a3c484d40) 00000020:00000080:3.0:1788875231.121687:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788875231.121693:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788875231.121763:0:14506:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788875231.121792:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d83271 00000020:00000080:3.0:1788875231.122030:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788875231.122034:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788875231.122038:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875231.122040:0:14506:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788875231.122042:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788875231.122046:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875231.122047:0:14506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788875231.122050:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788875231.122057:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e5a3c480000) 00000020:00000080:3.0:1788875231.122069:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788875231.122073:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788875231.122082:0:14506:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788875231.122085:0:14506:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788875231.122091:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788875231.122137:0:14506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e59064ff800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788875231.122151:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e5a3c4819c0) 00000020:00000080:3.0:1788875231.122160:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788875231.122203:0:14506:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788875231.122208:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d83286 00000020:00000080:3.0:1788875231.122292:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788875231.122297:0:14506:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788875231.122301:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x60858e6020d8328d 00080000:01000000:3.0:1788875231.122305:0:14506:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788875231.122309:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d83294 00010000:00010000:0.0:1788875231.219693:0:14506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788875231.220400:0:14506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788875231.220685:0:14506:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788875231.221479:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e5a04933380) 00000020:00000080:0.0:1788875231.221508:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788875231.221623:0:14506:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788875231.221637:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d832a2 00000020:00000080:1.0:1788875231.222550:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788875231.233557:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x60858e6020d832a9 00000020:00000080:2.0:1788875231.234115:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788875231.234127:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788875231.234134:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875231.234136:0:14506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788875231.234140:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788875231.234146:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875231.234147:0:14506:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788875231.234152:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788875231.234191:0:14506:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788875231.234217:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788875231.234221:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875231.234228:0:14506:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788875231.234232:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788875231.234234:0:14506:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788875231.234236:0:14506:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788875231.234237:0:14506:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788875231.234239:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788875231.234242:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875231.234243:0:14506:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788875231.234246:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788875231.234250:0:14506:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788875231.234265:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875231.234267:0:14506:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788875231.234273:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788875231.234278:0:14506:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:2.0:1788875231.234317:0:14506:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788875231.234321:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788875231.234338:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e5a362b99c0) 00000020:00000080:2.0:1788875231.234354:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788875231.234359:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788875231.234415:0:14506:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788875231.234420:0:14506:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788875231.234427:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d832b7 00010000:00080000:2.0:1788875231.234458:0:14506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a37384000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:2.0:1788875231.234717:0:14506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788875231.238592:0:14506:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788875231.238663:0:14506:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788875231.246446:0:14506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788875231.246529:0:14506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788875231.246641:0:14506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788875231.248167:0:14510:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788875231.248174:0:14510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788875231.250406:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788875231.250423:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788875231.250464:0:14506:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788875231.250488:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d832be 00000100:00080000:0.0:1788875231.250500:0:14506:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788875231.250506:0:14506:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5a37384000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875231.250545:0:14506:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288700 x1875771241093760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788875231.250585:0:14506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788875231.250647:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.250651:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.250653:0:14506:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788875231.250656:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788875231.250660:0:14506:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788875231.250661:0:14506:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788875231.250663:0:14506:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788875231.250664:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788875231.250667:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.250668:0:14506:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788875231.250671:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788875231.250675:0:14506:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788875231.250679:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.250680:0:14506:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788875231.250683:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788875231.250687:0:14506:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.107@tcp to nid 0x20000c0a8ca6b (192.168.202.107@tcp) 00000020:01000000:0.0:1788875231.250710:0:14506:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788875231.250713:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788875231.250726:0:14506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e5a049319c0) 00000020:00000080:0.0:1788875231.250738:0:14506:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788875231.250742:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788875231.250847:0:14506:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788875231.250853:0:14506:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788875231.250860:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x60858e6020d832cc 00000100:00100000:3.0:1788875231.251095:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241093760:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788875231.251152:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875771241093760 offset 0 length 520: 4 00000100:00100000:2.0:1788875231.251340:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875231.251355:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241093888:0@lo:400:kworker.0 00000100:00100000:2.0:1788875231.251399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.251544:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241093888 00000100:00100000:3.0:1788875231.251552:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241093888 00000100:00100000:3.0:1788875231.251611:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788875231.251621:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+9:3305:x1875771241093888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875231.251685:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+9:3305:x1875771241093888:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.251694:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788875231.251754:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241093888:0@lo:400:kworker.0 00010000:00080000:0.0:1788875231.253679:0:14506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a0495f800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1788875231.253991:0:14506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788875231.254228:0:14506:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788875231.254257:0:14506:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788875231.254906:0:14506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788875231.254983:0:14506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788875231.255055:0:14506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788875231.263173:0:14512:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788875231.263185:0:14512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788875231.264450:0:14506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788875231.264465:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788875231.264502:0:14506:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788875231.264525:0:14506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d832d3 00000100:00080000:0.0:1788875231.264538:0:14506:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788875231.264545:0:14506:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875231.264596:0:14506:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288e00 x1875771241094016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788875231.264681:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241094016:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788875231.264745:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875771241094016 offset 0 length 520: 4 00000100:00080000:0.0:1788875231.264871:0:14506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788875231.264952:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.264957:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.264959:0:14506:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788875231.264963:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875231.264967:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.264984:0:14506:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788875231.264990:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788875231.264992:0:14506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788875231.264994:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.264996:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.264997:0:14506:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788875231.265000:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875231.265009:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.265010:0:14506:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788875231.265015:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788875231.265042:0:14506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14506:1875771241094144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875231.265094:0:14506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875231.265123:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094144 00000100:00100000:0.0:1788875231.265129:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094144 00000100:00100000:0.0:1788875231.265171:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788875231.265180:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+9:14506:x1875771241094144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875231.265425:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+9:14506:x1875771241094144:12345-0@lo:502:llog_process_th.0 Request processed in 246us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875231.265434:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788875231.265476:0:14506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788875231.265497:0:14506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14506:1875771241094144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875231.265521:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.265525:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.265527:0:14506:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788875231.265531:0:14506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788875231.268583:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788875231.268625:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788875231.268653:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83263 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.268667:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44a00/0x60858e6020d8325c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83263 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875231.268696:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e59064ff800 from 1 10000000:01000000:3.0:1788875231.268699:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788875231.268753:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.268762:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.268805:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.268831:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788875231.268918:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.268964:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.269410:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094272 00000100:00100000:3.0:1788875231.269418:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094272 00000100:00100000:3.0:1788875231.269470:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788875231.269480:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+9:14470:x1875771241094272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875231.269493:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875231.269506:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d832da expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.269529:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d832da expref: 10 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.269540:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d832da expref: 10 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.269564:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15000, rc 0) 00000100:00100000:3.0:1788875231.269616:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+10:14470:x1875771241094272:12345-0@lo:101:mount.lustre.0 Request processed in 137us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.269623:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788875231.269687:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875231.269701:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.269711:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.270530:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094400:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788875231.270587:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.270660:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.278205:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094400 00000100:00100000:1.0:1788875231.278227:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094400 00000100:00100000:1.0:1788875231.278316:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788875231.278330:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+10:14470:x1875771241094400:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788875231.278372:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788875231.278380:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788875231.278520:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+10:14470:x1875771241094400:12345-0@lo:256:mount.lustre.0 Request processed in 192us (7932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.278528:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788875231.278759:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094400:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788875231.279439:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788875231.279463:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.279475:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875231.279485:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e59064ff800 from 1 10000000:01000000:3.0:1788875231.279487:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788875231.279530:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.279551:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.279562:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.279594:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788875231.279649:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.279696:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.279986:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094528 00000100:00100000:2.0:1788875231.279994:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094528 00000100:00100000:2.0:1788875231.280037:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788875231.280046:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+10:14470:x1875771241094528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875231.280060:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875231.280077:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d832e8 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.280102:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d832e8 expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.280112:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d832e8 expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875231.280120:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c45600, rc 0) 00000100:00100000:2.0:1788875231.280159:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241094528:12345-0@lo:101:mount.lustre.0 Request processed in 113us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.280166:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788875231.280560:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875231.280588:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.280598:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.280674:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875231.280705:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.280858:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.286417:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094656 00000100:00100000:2.0:1788875231.286436:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094656 00000100:00100000:2.0:1788875231.286518:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788875231.286531:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241094656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.288455:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241094656:12345-0@lo:501:mount.lustre.0 Request processed in 1919us (7741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.288469:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788875231.293459:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875231.293545:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788875231.293641:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.293738:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875231.297679:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094784 00000100:00100000:0.0:1788875231.297697:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094784 00000100:00100000:0.0:1788875231.298021:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788875231.298033:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241094784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788875231.298450:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241094784:12345-0@lo:503:mount.lustre.0 Request processed in 418us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875231.298460:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788875231.298570:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241094784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788875231.299558:0:14514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14514:1875771241094912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875231.300481:0:14514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875231.300627:0:14514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1080a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.300666:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241094912 00000100:00100000:1.0:1788875231.300676:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241094912 00000100:00100000:1.0:1788875231.300768:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788875231.301014:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14514:x1875771241094912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875231.301435:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14514:x1875771241094912:12345-0@lo:502:llog_process_th.0 Request processed in 426us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.301444:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788875231.301553:0:14514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14514:1875771241094912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875231.301607:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875231.301619:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.301621:0:14514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788875231.301632:0:14514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e59064ff800 00000020:00000080:0.0:1788875231.301635:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788875231.301643:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.301647:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.301649:0:14514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788875231.301651:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875231.301653:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.301654:0:14514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788875231.301657:0:14514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e59064ff800 00000020:00000080:0.0:1788875231.301659:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788875231.302218:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.302224:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.302226:0:14514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788875231.302229:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875231.302232:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.302233:0:14514:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788875231.302237:0:14514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e59064ff800 00000020:00000080:0.0:1788875231.302239:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788875231.304433:0:14514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14514:1875771241095040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875231.304978:0:14514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875231.307222:0:14514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875231.308027:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095040 00000100:00100000:1.0:1788875231.308041:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095040 00000100:00100000:1.0:1788875231.308114:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788875231.308125:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14514:x1875771241095040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875231.308435:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14514:x1875771241095040:12345-0@lo:502:llog_process_th.0 Request processed in 310us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.308450:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788875231.313101:0:14514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14514:1875771241095040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788875231.313152:0:14514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875231.313161:0:14514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875231.313163:0:14514:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788875231.313170:0:14514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788875231.320217:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788875231.320336:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788875231.320367:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.320384:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875231.320441:0:14470:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788875231.320445:0:14470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e59064ff800 10000000:01000000:1.0:1788875231.320448:0:14470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e59064ff800 10000000:01000000:1.0:1788875231.320453:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788875231.320460:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e59064ff800 from 1 10000000:01000000:1.0:1788875231.320462:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788875231.320510:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.321166:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.321180:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875231.321210:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788875231.321633:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875231.321728:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1a7fa000 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.328169:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095168 00000100:00100000:3.0:1788875231.328185:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095168 00000100:00100000:3.0:1788875231.328568:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788875231.328591:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241095168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875231.328611:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875231.328632:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14800/0x60858e6020d832fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d832f6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.328659:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14800/0x60858e6020d832fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d832f6 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.328671:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14800/0x60858e6020d832fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d832f6 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.328680:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14800, rc 0) 00000100:00100000:3.0:1788875231.328829:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095168:12345-0@lo:101:mount.lustre.0 Request processed in 242us (7196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.328835:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788875231.331696:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875231.331728:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832fd expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875231.331751:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d832fd expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.342155:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.342244:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.342308:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a063bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.342348:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095296 00000100:00100000:2.0:1788875231.342356:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095296 00000100:00100000:2.0:1788875231.342420:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788875231.342431:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.342739:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095296:12345-0@lo:501:mount.lustre.0 Request processed in 308us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.342748:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788875231.342818:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875231.342868:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875231.342916:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875231.342930:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a063bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.342943:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095424 00000100:00100000:2.0:1788875231.342947:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095424 00000100:00100000:2.0:1788875231.342968:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788875231.342975:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875231.343116:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095424:12345-0@lo:503:mount.lustre.0 Request processed in 140us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.343123:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788875231.343168:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788875231.346746:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14519:1875771241095552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788875231.346874:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875231.347052:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a357a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.347242:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095552 00000100:00100000:2.0:1788875231.347253:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095552 00000100:00100000:2.0:1788875231.347395:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788875231.347407:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14519:x1875771241095552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788875231.349489:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14519:x1875771241095552:12345-0@lo:502:llog_process_th.0 Request processed in 2074us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875231.349506:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788875231.354161:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14519:1875771241095552:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788875231.354564:0:14519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788875231.354595:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e5a04930000) 00000020:00000080:0.0:1788875231.354618:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788875231.354732:0:14519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e59064ff800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788875231.354737:0:14519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e59064ff800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788875231.354741:0:14519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e59064ff800 4 00010000:00080000:0.0:1788875231.354802:0:14519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5a06645800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.107@tcp at head 00010000:00010000:0.0:1788875231.358436:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788875231.358732:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788875231.359172:0:14519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788875231.359195:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x60858e6020d8330b 00000100:00080000:0.0:1788875231.359207:0:14519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788875231.359214:0:14519:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e5a06645800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875231.359791:0:14519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288380 x1875771241095680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788875231.359833:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241095680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788875231.359932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788875231.359996:0:14519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788875231.360844:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14519:1875771241095808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788875231.360927:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875231.360957:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1a7fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788875231.361370:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095808 00000100:00100000:0.0:1788875231.361378:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095808 00000100:00100000:0.0:1788875231.361433:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788875231.361525:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:14519:x1875771241095808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788875231.362986:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095680 00000100:00100000:3.0:1788875231.363005:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095680 00000100:00100000:3.0:1788875231.363052:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875231.363060:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875771241095680:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788875231.363180:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875771241095680:12345-0@lo:38:llog_process_th.0 Request processed in 118us (3247us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788875231.363188:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788875231.365633:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788875231.365649:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a06645800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788875231.365657:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788875231.365662:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241095680:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788875231.369222:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:14519:x1875771241095808:12345-0@lo:502:llog_process_th.0 Request processed in 7770us (8285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875231.369235:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788875231.369592:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23009a34-c6dd-4af5-b962-084fb475da02:14519:1875771241095808:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788875231.369630:0:14519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788875231.370385:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788875231.370412:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788875231.370434:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832fd expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.370461:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35b35800/0x60858e6020d832f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d832fd expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788875231.370508:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788875231.370510:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788875231.370512:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875231.370513:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875231.370514:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875231.370516:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875231.370517:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788875231.370519:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788875231.370521:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875231.370522:0:14470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788875231.370526:0:14470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788875231.370528:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788875231.370529:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788875231.370531:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875231.370532:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875231.370533:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875231.370534:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875231.370535:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788875231.370536:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788875231.370537:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875231.370538:0:14470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788875231.370570:0:14470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788875231.370596:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788875231.370650:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.370686:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788875231.371014:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241095936 00000100:00100000:2.0:1788875231.371022:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241095936 00000100:00100000:2.0:1788875231.371134:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788875231.371145:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14470:x1875771241095936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788875231.371171:0:14483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788875231.371186:0:14483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788875231.434402:0:14483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788875231.434415:0:14483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788875231.434436:0:14504:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788875231.434440:0:14504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788875231.434474:0:14504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.434513:0:14504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d832da expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.434523:0:14504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.434562:0:14504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d832da expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.435111:0:14504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d832da expref: 12 pid: 14482 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.435132:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241096064:0@lo:104: 00000100:00100000:3.0:1788875231.435196:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.435231:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1813a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875231.435405:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096064 00000100:00100000:3.0:1788875231.435413:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096064 00000100:00100000:3.0:1788875231.435659:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875231.435669:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241096064:12345-0@lo:104: 00010000:00010000:3.0:1788875231.435684:0:14471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.435741:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788875231.435747:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241096064:12345-0@lo:104: Request processed in 80us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.435754:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788875231.439054:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875231.439132:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439164:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15400 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875231.439169:0:14477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439179:0:14477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875231.439187:0:14477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875231.439193:0:14477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788875231.439464:0:14477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439472:0:14477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875231.439498:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439506:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a15400/0x60858e6020d832da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832e1 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439525:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875231.439527:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875231.439529:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875231.439554:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875231.439570:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241096192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875231.439650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875231.439720:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241096064:0@lo:104: 00010000:00010000:3.0:1788875231.439751:0:14504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.439823:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096192 00000100:00100000:3.0:1788875231.439829:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096192 00010000:00010000:3.0:1788875231.439851:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d832da expref: 13 pid: 14482 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875231.439877:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875231.439894:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+13:3304:x1875771241096192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875231.439906:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875231.439911:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d832da expref: 13 pid: 14482 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439922:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d832da expref: 13 pid: 14482 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439935:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15000/0x60858e6020d832e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d832da expref: 13 pid: 14482 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439949:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439957:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788875231.439971:0:14473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005531594s 00010000:00010000:3.0:1788875231.439975:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.439982:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440000:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440006:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440011:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875231.440016:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440024:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440037:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440046:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875231.440700:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+12:3304:x1875771241096192:12345-0@lo:103:ldlm_bl.0 Request processed in 804us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.440710:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788875231.440762:0:14504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440797:0:14504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875231.440805:0:14504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83312 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875231.441346:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241096192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788875231.456241:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+11:14470:x1875771241095936:12345-0@lo:253:mount.lustre.0 Request processed in 85088us (85581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875231.456374:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:14470:1875771241095936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788875231.456403:0:14470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788875231.456406:0:14470:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788875231.456408:0:14470:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788875231.456409:0:14470:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875231.456411:0:14470:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875231.456412:0:14470:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875231.456413:0:14470:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875231.456414:0:14470:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788875231.456415:0:14470:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788875231.456417:0:14470:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875231.456418:0:14470:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788875231.456433:0:14470:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788875231.456817:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00080000:10000000:3.0:1788875231.461312:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875231.461489:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788875231.462418:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875231.463165:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788875231.463513:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875231.463689:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788875231.466406:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875231.466592:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788875231.466921:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875231.467157:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788875231.467429:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875231.467605:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788875231.576182:0:14470:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788875231.584160:0:14470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788875231.584672:0:14526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788875231.584830:0:14526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788875231.586854:0:14526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788875231.586935:0:14526:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788875231.586940:0:14526:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788875231.589813:0:14470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788875231.589957:0:14470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788875231.590404:0:14470:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788875231.590412:0:14470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788875231.590531:0:14470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788875231.596382:0:14525:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788875231.596391:0:14525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788875231.598239:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788875231.604034:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788875231.604127:0:14470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788875231.607198:0:14470:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788875231.614680:0:14470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788875231.654105:0:14470:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788875231.654156:0:14470:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae1241597988 00100000:10000000:3.0:1788875231.654165:0:14470:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788875231.664077:0:14470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788875231.664112:0:14470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788875231.664135:0:14470:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788875231.664166:0:14470:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788875231.888389:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788875232.398840:0:14485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788875232.398848:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e59064ff800 from 6 10000000:01000000:1.0:1788875232.398853:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788875232.398895:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875232.398907:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875232.398918:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875232.398948:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241096320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788875232.399016:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875232.399063:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a057ab540 going to sleep for 11 seconds 00000100:00100000:3.0:1788875232.399176:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096320 00000100:00100000:3.0:1788875232.399183:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096320 00000100:00100000:3.0:1788875232.399374:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788875232.399385:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:14485:x1875771241096320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788875232.399404:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875232.399417:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83319 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875232.399442:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83319 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875232.399451:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83319 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875232.399460:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14200, rc 0) 00000100:00100000:3.0:1788875232.399502:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241096320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875232.399509:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788875232.399689:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241096320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875232.399704:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875232.399714:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875232.399765:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241096448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788875232.399815:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875232.399831:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a057ab540 going to sleep for 11 seconds 00000100:00100000:1.0:1788875232.399843:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096448 00000100:00100000:1.0:1788875232.399847:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096448 00000100:00100000:1.0:1788875232.399872:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788875232.399879:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241096448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788875232.399893:0:14483:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788875232.399909:0:14483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788875232.399912:0:14483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788875232.399983:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241096448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875232.399991:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788875232.400021:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241096448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788875232.400059:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788875232.400070:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875232.400079:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875232.401024:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788875232.912427:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788875233.422546:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788875233.937788:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875234.958060:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875235.982678:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788875236.686884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788875236.686891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788875236.686894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788875236.686898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788875236.686901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788875236.686904:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788875236.686908:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a06645800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788875236.686921:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e5a06645800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875236.686943:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3628a300 x1875771241096704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788875236.686981:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241096704:0@lo:38:kworker.0 00000100:00100000:0.0:1788875236.687094:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875236.687183:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241096576:0@lo:400:kworker.0 00000100:00100000:0.0:1788875236.687224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875236.687275:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096576 00000100:00100000:0.0:1788875236.687283:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096576 00000100:00100000:0.0:1788875236.687322:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788875236.687336:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:3304:x1875771241096576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875236.687401:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:3304:x1875771241096576:12345-0@lo:400:kworker.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875236.687409:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788875236.687728:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241096576:0@lo:400:kworker.0 00000100:00100000:1.0:1788875236.687860:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096704 00000100:00100000:1.0:1788875236.687864:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096704 00000100:00100000:1.0:1788875236.687891:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788875236.687897:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875771241096704:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788875236.687917:0:14490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:1.0:1788875236.687952:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x60858e6020d83327 00000004:00100000:1.0:1788875236.687967:0:14490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788875236.688098:0:14490:0:(import.c:65:import_set_state_nolock()) ffff9e5a06647800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788875236.688141:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875771241096704:12345-0@lo:38:kworker.0 Request processed in 243us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875236.688149:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788875236.690275:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a3628a300 x1875771241096704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788875246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788875236.690297:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788875236.690306:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788875236.690313:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788875236.690317:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a06645800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788875236.690324:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875771241096704:0@lo:38:kworker.0 00010000:00010000:3.0:1788875237.015348:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788875237.170937:0:14769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788875238.030100:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875239.063922:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875240.077988:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788875240.872445:0:14920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe45f9bdd0 20000000:00000080:0.0:1788875240.872466:0:14920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5a18dc5000 uarg=0000000000000000 20000000:01000000:0.0:1788875240.872511:0:14920:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788875240.872520:0:14920:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788875240.872524:0:14920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788875240.873562:0:14921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788875240.873730:0:14920:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788875240.880154:0:14920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788875240.880253:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875240.880356:0:14920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d832e8 expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875240.880366:0:14920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875240.880428:0:14920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875240.880445:0:14920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 11 pid: 14483 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875240.880461:0:14920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14920:1875771241096832:0@lo:104: 00000100:00100000:0.0:1788875240.880539:0:14920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875240.880641:0:14920:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0634f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875240.880690:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096832 00000100:00100000:3.0:1788875240.880697:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096832 00000100:00100000:3.0:1788875240.880808:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875240.880818:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14920:x1875771241096832:12345-0@lo:104: 00010000:00010000:3.0:1788875240.880833:0:14471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875240.880898:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788875240.880904:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14920:x1875771241096832:12345-0@lo:104: Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875240.880911:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788875240.881019:0:14920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14920:1875771241096832:0@lo:104: 00010000:00010000:1.0:1788875240.881041:0:14920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881122:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875240.881130:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881138:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:2.0:1788875240.881141:0:14477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881149:0:14477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788875240.881155:0:14477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875240.881161:0:14477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788875240.881259:0:14477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881267:0:14477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788875240.881364:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881372:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14000/0x60858e6020d832e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d832ef expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881398:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875240.881400:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875240.881401:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875240.881422:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241096960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875240.881453:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875240.881506:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241096960 00000100:00100000:2.0:1788875240.881510:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241096960 00010000:00010000:2.0:1788875240.881529:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 12 pid: 14483 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875240.881552:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788875240.881559:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+12:3305:x1875771241096960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875240.881569:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875240.881574:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 12 pid: 14483 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881585:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 12 pid: 14483 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881598:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35c45600/0x60858e6020d832ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d832e8 expref: 12 pid: 14483 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881610:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881617:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881630:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881643:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881651:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881658:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881663:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875240.881668:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881675:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881686:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875240.881695:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875240.881721:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+11:3305:x1875771241096960:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875240.881728:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788875240.881756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241096960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788875240.881845:0:14920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875240.881854:0:14920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875240.881867:0:14920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee1a00/0x60858e6020d8332e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875241.104950:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788875241.809615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788875241.809621:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788875241.809624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788875241.809628:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788875241.809666:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23009a34-c6dd-4af5-b962-084fb475da02:3306:1875771241097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788875241.810090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875241.810174:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241097216:0@lo:400:kworker.0 00000100:00100000:3.0:1788875241.810207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875241.811082:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097216 00000100:00100000:3.0:1788875241.811093:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097216 00000100:00100000:3.0:1788875241.811145:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875241.811155:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241097216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875241.811221:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241097216:12345-0@lo:400:kworker.0 Request processed in 67us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875241.811228:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788875241.811571:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097088 00000100:00100000:1.0:1788875241.811575:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097088 00000100:00100000:1.0:1788875241.811604:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788875241.811612:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:3306:x1875771241097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875241.811654:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+11:3306:x1875771241097088:12345-0@lo:400:kworker.0 Request processed in 43us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875241.811660:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788875241.812129:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a3cd8a680 x1875771241097216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875241.812145:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241097216:0@lo:400:kworker.0 00000100:00100000:1.0:1788875241.814390:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875231/real 1788875231] req@ffff9e5a36288e00 x1875771241094016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875241.814427:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a36288e00 x1875771241094016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875241.814442:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875231/real 1788875231] req@ffff9e5a36288700 x1875771241093760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875241.814458:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a36288700 x1875771241093760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788875241.814488:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788875241.814518:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788875241.814525:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241094016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788875241.814533:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a37384000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788875241.814542:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788875241.814570:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241093760:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788875241.816232:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23009a34-c6dd-4af5-b962-084fb475da02:3306:1875771241097088:0@lo:400:kworker.0 00000100:00080000:1.0:1788875241.816274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788875241.816279:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788875241.816282:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a37384000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788875241.816287:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1788875241.816291:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788875241.816298:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5a37384000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1788875241.816330:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a355e1180 x1875771241097344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788875241.816349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788875241.816352:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788875241.816354:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788875241.816357:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1788875241.816360:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788875241.816363:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:1.0:1788875241.816373:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a355e3480 x1875771241097472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788875241.816396:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241097344:0@lo:8:kworker.0 00000400:00000100:1.0:1788875241.816445:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875771241097344 offset 0 length 520: 4 00000100:00100000:1.0:1788875241.816490:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241097472:0@lo:8:kworker.0 00000400:00000100:1.0:1788875241.816510:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875771241097472 offset 0 length 520: 4 00010000:00010000:1.0:1788875242.129647:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788875242.640767:0:14485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788875242.640809:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e59064ff800 from 10 10000000:01000000:2.0:1788875242.640814:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788875242.640866:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875242.640894:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875242.640905:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875242.640928:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875242.641003:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875242.642066:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a063bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788875242.646932:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097600 00000100:00100000:0.0:1788875242.646946:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097600 00000100:00100000:0.0:1788875242.647589:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788875242.647603:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+11:14485:x1875771241097600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875242.647621:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875242.647642:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83335 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875242.647668:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83335 expref: 12 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875242.647678:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83335 expref: 12 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875242.647687:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0400, rc 0) 00000100:00100000:0.0:1788875242.647797:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241097600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (6769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875242.647805:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788875242.648072:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875242.648094:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875242.648106:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875242.648173:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875242.648205:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875242.648233:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a063bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788875242.648247:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097728 00000100:00100000:1.0:1788875242.648254:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097728 00000100:00100000:1.0:1788875242.648291:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788875242.648298:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241097728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875242.648588:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241097728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875242.648595:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788875242.648805:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788875242.648841:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875242.648882:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875242.648909:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a356b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788875242.648940:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097856 00000100:00100000:0.0:1788875242.648952:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097856 00000100:00100000:0.0:1788875242.648982:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788875242.649070:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241097856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875242.649230:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:14485:x1875771241097856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875242.649236:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788875242.649266:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241097856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788875242.650663:0:14981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788875242.650869:0:14485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788875242.650894:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788875242.650906:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875242.650918:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875243.150285:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788875243.664597:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788875244.174909:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875245.203116:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875246.231926:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788875246.937265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875246.937274:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788875246.937277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875246.937281:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788875246.939184:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241097984:0@lo:400:kworker.0 00000100:00100000:2.0:1788875246.939316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875246.940826:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241098112:0@lo:400:kworker.0 00000100:00100000:2.0:1788875246.940912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875246.940996:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241097984 00000100:00100000:2.0:1788875246.941009:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241097984 00000100:00100000:2.0:1788875246.941094:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788875246.941105:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:3304:x1875771241097984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875246.941187:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:3304:x1875771241097984:12345-0@lo:400:kworker.0 Request processed in 83us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875246.941197:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788875246.941274:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241097984:0@lo:400:kworker.0 00000100:00100000:0.0:1788875246.943266:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098112 00000100:00100000:0.0:1788875246.943289:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098112 00000100:00100000:0.0:1788875246.944297:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788875246.944314:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875246.945260:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241098112:12345-0@lo:400:kworker.0 Request processed in 944us (4339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875246.945274:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788875246.949867:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a3fd4a300 x1875771241098112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875246.949896:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241098112:0@lo:400:kworker.0 00010000:00010000:3.0:1788875247.247222:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788875247.711189:0:15169:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788875247.711194:0:15169:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788875247.711344:0:15169:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5a06642800 00000020:01000004:1.0:1788875247.713874:0:15169:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788875247.713895:0:15169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788875247.713915:0:15169:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e5a35d019c0) 00000020:00000080:1.0:1788875247.713935:0:15169:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788875247.734161:0:15169:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788875247.735000:0:15169:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788875247.736042:0:15169:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788875247.736280:0:15169:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788875247.736967:0:15169:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788875247.737316:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:1.0:1788875247.737471:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:1.0:1788875247.737548:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:1.0:1788875247.740997:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 64: rc = 0 00100000:10000000:1.0:1788875247.741274:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 64: rc = 0 00100000:10000000:1.0:1788875247.741863:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 64: rc = 0 00100000:10000000:1.0:1788875247.742132:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 64: rc = 0 00100000:10000000:1.0:1788875247.742559:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 64: rc = 0 00100000:10000000:1.0:1788875247.742930:0:15169:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 64: rc = 0 00000020:00000080:1.0:1788875247.743567:0:15169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788875247.743579:0:15169:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788875247.743593:0:15169:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x60858e6020d8334a 00000020:01000004:1.0:1788875247.743603:0:15169:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788875247.743624:0:15169:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788875247.743627:0:15169:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788875247.743633:0:15169:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788875247.743638:0:15169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788875247.743721:0:15169:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e5a35d03380) 00000020:00000080:1.0:1788875247.743733:0:15169:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788875247.746394:0:15169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788875247.746636:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788875247.746643:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788875247.748320:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788875247.748335:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788875247.748708:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788875247.748714:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788875247.750195:0:15169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788875247.754989:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788875247.755003:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788875247.755929:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788875247.755936:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788875247.787461:0:15169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788875247.787727:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788875247.787734:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788875247.795507:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788875247.795531:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788875247.797000:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788875247.797075:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788875247.802282:0:15169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788875247.802756:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788875247.802763:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788875247.804098:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788875247.804109:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788875247.857467:0:15169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788875247.858059:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788875247.858068:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788875247.860830:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788875247.860909:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788875247.861964:0:15169:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788875247.861990:0:15169:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788875247.861996:0:15169:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788875247.877578:0:15169:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788875247.877617:0:15169:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.107@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788875247.877626:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788875247.877627:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875247.877628:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875247.877629:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875247.877630:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875247.877631:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875247.877632:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875247.877634:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875247.877635:0:15169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875247.877638:0:15169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788875247.877640:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788875247.877641:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875247.877642:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875247.877643:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875247.877644:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875247.877645:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875247.877646:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875247.877646:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875247.877647:0:15169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875247.877687:0:15169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788875247.877708:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788875247.877822:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.877881:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.878070:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098240 00000100:00100000:1.0:1788875247.878079:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098240 00000100:00100000:1.0:1788875247.878137:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788875247.878147:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:15169:x1875771241098240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788875247.878188:0:14481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788875247.878192:0:14481:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788875247.878195:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788875247.886295:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+12:15169:x1875771241098240:12345-0@lo:253:mount.lustre.0 Request processed in 8139us (8463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875247.886311:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788875247.886447:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788875247.886464:0:15169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788875247.886468:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788875247.886469:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875247.886471:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875247.886472:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875247.886473:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875247.886475:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875247.886477:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875247.886480:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875247.886481:0:15169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788875247.886505:0:15169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5a06642800 from lustre-OST0000 10000000:01000000:2.0:1788875247.886532:0:15169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788875247.886535:0:15169:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788875247.886555:0:15169:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e5a362bcd40 local copy 00010000:00010000:2.0:1788875247.886567:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875247.886890:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875247.886928:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875247.887071:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098368 00000100:00100000:0.0:1788875247.887079:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098368 00000100:00100000:0.0:1788875247.887130:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788875247.887139:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:15169:x1875771241098368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788875247.887302:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+12:15169:x1875771241098368:12345-0@lo:501:mount.lustre.0 Request processed in 164us (373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788875247.887309:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788875247.887381:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788875247.887397:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098368:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788875247.887423:0:15169:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788875247.887581:0:15169:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788875247.887593:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.887608:0:15169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875247.887635:0:15169:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5a06642800 10000000:01000000:2.0:1788875247.887641:0:15169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788875247.887716:0:15169:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e5a362bcd40 10000000:01000000:2.0:1788875247.887721:0:15169:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788875247.887725:0:15169:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e5a362bcd40 from 1 10000000:01000000:2.0:1788875247.887729:0:15169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788875247.887758:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.887767:0:15169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.888034:0:15169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875247.888085:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875247.888120:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.888153:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788875247.888293:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098496 00000100:00100000:3.0:1788875247.888300:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098496 00000100:00100000:3.0:1788875247.888342:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788875247.888352:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+12:15169:x1875771241098496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788875247.888364:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875247.888379:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15000/0x60858e6020d8335f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83358 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875247.888401:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15000/0x60858e6020d8335f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83358 expref: 13 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875247.888412:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a15000/0x60858e6020d8335f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83358 expref: 13 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875247.888429:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15000, rc 0) 00000100:00100000:3.0:1788875247.888477:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+13:15169:x1875771241098496:12345-0@lo:101:mount.lustre.0 Request processed in 127us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875247.888484:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788875247.888668:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875247.888683:0:15169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8335f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.888692:0:15169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8335f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875247.888710:0:15169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788875247.888727:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8335f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.888734:0:15169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44200/0x60858e6020d83358 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8335f expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875247.888741:0:15169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788875247.888745:0:15169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788875247.888750:0:15169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788875247.888752:0:15169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788875247.888769:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.888813:0:15169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.888821:0:15169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875247.888840:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875247.888866:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.888897:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.889059:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098624 00000100:00100000:1.0:1788875247.889064:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098624 00000100:00100000:1.0:1788875247.889105:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788875247.889113:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+13:15169:x1875771241098624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875247.889121:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875247.889129:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35b34c00/0x60858e6020d8336d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83366 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.889157:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35b34c00/0x60858e6020d8336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83366 expref: 14 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.889165:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35b34c00/0x60858e6020d8336d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83366 expref: 14 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.889172:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34c00, rc 0) 00000100:00100000:1.0:1788875247.889209:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241098624:12345-0@lo:101:mount.lustre.0 Request processed in 97us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875247.889215:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788875247.889425:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875247.889436:0:15169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8336d expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.889444:0:15169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8336d expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875247.890321:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788875247.891836:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788875247.892135:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788875247.892181:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788875247.892216:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788875247.892262:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788875247.892297:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788875247.892330:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788875247.892393:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788875247.892401:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788875247.893394:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875247.893474:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.893518:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.893577:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098752 00000100:00100000:1.0:1788875247.893585:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098752 00000100:00100000:1.0:1788875247.893641:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788875247.893651:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241098752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875247.894087:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241098752:12345-0@lo:501:mount.lustre.0 Request processed in 437us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875247.894095:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788875247.894426:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875247.894466:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875247.894508:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.894537:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788875247.894598:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241098880 00000100:00100000:0.0:1788875247.894604:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241098880 00000100:00100000:0.0:1788875247.894639:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788875247.894658:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241098880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788875247.895017:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241098880:12345-0@lo:503:mount.lustre.0 Request processed in 369us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875247.895024:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788875247.895249:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241098880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788875247.897874:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788875247.897980:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875247.898066:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.898120:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788875247.898572:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099008 00000100:00100000:3.0:1788875247.898581:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099008 00000100:00100000:3.0:1788875247.898628:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788875247.898637:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241099008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875247.898965:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241099008:12345-0@lo:502:mount.lustre.0 Request processed in 328us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875247.898973:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788875247.899466:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788875247.899758:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788875247.899845:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788875247.899878:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788875247.899925:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788875247.899962:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788875247.899997:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788875247.900044:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788875247.900082:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788875247.901338:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788875247.901433:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788875247.901472:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788875247.901521:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788875247.901573:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875247.901671:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.901713:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04fa6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.901815:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099136 00000100:00100000:1.0:1788875247.901822:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099136 00000100:00100000:1.0:1788875247.901877:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788875247.901886:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241099136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788875247.902107:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241099136:12345-0@lo:502:mount.lustre.0 Request processed in 211us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875247.902116:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788875247.902350:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788875247.902442:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788875247.902454:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788875247.905534:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788875247.905548:0:15183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788875247.905557:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788875247.905559:0:15183:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788875247.905567:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788875247.905582:0:15183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e5a362bb380) 00000020:00000080:2.0:1788875247.905604:0:15183:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788875247.905619:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788875247.905768:0:15183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a06642800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788875247.905804:0:15183:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788875247.905813:0:15183:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x60858e6020d8337b 00010000:00010000:2.0:1788875247.912896:0:15183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788875247.915355:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788875247.924604:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788875247.928841:0:15183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788875247.928854:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875247.928861:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928863:0:15183:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788875247.928868:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788875247.928870:0:15183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788875247.928872:0:15183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788875247.928873:0:15183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788875247.928875:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788875247.928877:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928879:0:15183:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788875247.928892:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875247.928896:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928897:0:15183:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788875247.928901:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788875247.928903:0:15183:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788875247.928905:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875247.928908:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928909:0:15183:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788875247.928912:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875247.928914:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928915:0:15183:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788875247.928918:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788875247.928982:0:15183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875247.928986:0:15183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875247.928987:0:15183:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788875247.928991:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788875247.935792:0:15169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788875247.935841:0:15169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788875247.935869:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8336d expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.935883:0:15169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45000/0x60858e6020d83366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8336d expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875247.935891:0:15169:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06642800 from 1 10000000:01000000:1.0:1788875247.935894:0:15169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788875247.935936:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.935945:0:15169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.935957:0:15169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875247.935983:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788875247.936048:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875247.936089:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.936259:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099264 00000100:00100000:1.0:1788875247.936267:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099264 00000100:00100000:1.0:1788875247.936316:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788875247.936326:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+14:15169:x1875771241099264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875247.936342:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875247.936355:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83382 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.936377:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83382 expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.936399:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83382 expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.936408:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b35c00, rc 0) 00000100:00100000:1.0:1788875247.936458:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099264:12345-0@lo:101:mount.lustre.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875247.936465:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788875247.936513:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875247.936528:0:15169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.936537:0:15169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788875247.937345:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788875247.937729:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788875247.937990:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788875247.938037:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788875247.938100:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788875247.938108:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788875247.938173:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875247.938226:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875247.938264:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875247.938373:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099392 00000100:00100000:2.0:1788875247.938381:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099392 00000100:00100000:2.0:1788875247.938428:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788875247.938438:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875247.938644:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099392:12345-0@lo:501:mount.lustre.0 Request processed in 207us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875247.938652:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788875247.939037:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875247.939073:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788875247.939115:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875247.939187:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788875247.941020:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099520 00000100:00100000:0.0:1788875247.941031:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099520 00000100:00100000:0.0:1788875247.941117:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788875247.941128:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788875247.941373:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099520:12345-0@lo:503:mount.lustre.0 Request processed in 245us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875247.941380:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788875247.941488:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788875247.942079:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788875247.942159:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788875247.942219:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.946039:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099648 00000100:00100000:2.0:1788875247.946054:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099648 00000100:00100000:2.0:1788875247.946107:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788875247.946117:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875247.946381:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099648:12345-0@lo:502:mount.lustre.0 Request processed in 265us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875247.946390:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788875247.946590:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a1b6e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.946740:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788875247.947211:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788875247.947266:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788875247.947314:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788875247.947367:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788875247.947402:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788875247.947464:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788875247.947500:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788875247.947534:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788875247.947578:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788875247.947987:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875247.948055:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a0807b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788875247.948109:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099776 00000100:00100000:2.0:1788875247.948115:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099776 00000100:00100000:2.0:1788875247.948194:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788875247.948205:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875247.948400:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099776:12345-0@lo:502:mount.lustre.0 Request processed in 197us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875247.948408:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788875247.948503:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788875247.948636:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788875247.948647:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788875247.956360:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788875247.956375:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956377:0:15187:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788875247.956384:0:15187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a06642800 00000020:00000080:1.0:1788875247.956386:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788875247.956393:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788875247.956395:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956410:0:15187:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788875247.956413:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788875247.956427:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956428:0:15187:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788875247.956432:0:15187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a06642800 00000020:00000080:1.0:1788875247.956434:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788875247.956510:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788875247.956514:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956515:0:15187:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788875247.956518:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788875247.956521:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956522:0:15187:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788875247.956525:0:15187:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5a06642800 00000020:00000080:1.0:1788875247.956527:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788875247.956566:0:15187:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788875247.956569:0:15187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788875247.956570:0:15187:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788875247.956574:0:15187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788875247.958225:0:15169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788875247.958268:0:15169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875247.958293:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.958306:0:15169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875247.958357:0:15169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788875247.958360:0:15169:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5a06642800 10000000:01000000:2.0:1788875247.958363:0:15169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5a06642800 10000000:01000000:2.0:1788875247.958368:0:15169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788875247.958373:0:15169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a06642800 from 1 10000000:01000000:2.0:1788875247.958376:0:15169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788875247.958454:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.958463:0:15169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.958475:0:15169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875247.958501:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875247.958571:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875247.958621:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875247.960861:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241099904 00000100:00100000:1.0:1788875247.960876:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241099904 00000100:00100000:1.0:1788875247.960942:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788875247.960953:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241099904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875247.960968:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875247.960986:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35b34000/0x60858e6020d83397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83390 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.961014:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35b34000/0x60858e6020d83397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83390 expref: 16 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.961024:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35b34000/0x60858e6020d83397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83390 expref: 16 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875247.961050:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35b34000, rc 0) 00000100:00100000:1.0:1788875247.961267:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241099904:12345-0@lo:101:mount.lustre.0 Request processed in 315us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875247.961275:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788875247.961408:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241099904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875247.961436:0:15169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83397 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875247.961455:0:15169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83397 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875247.962997:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788875247.968894:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788875247.983560:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788875247.983936:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788875247.983991:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788875247.984042:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788875247.984077:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788875247.984216:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788875247.984255:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788875247.984287:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788875247.984336:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788875247.984373:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788875247.984406:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788875247.984469:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788875247.984509:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788875247.984540:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788875247.984586:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788875247.987499:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788875247.987594:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788875247.987699:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788875247.987738:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788875247.987959:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788875247.988037:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788875247.988093:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788875247.988143:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788875247.988196:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788875247.988232:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788875247.988266:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788875247.988332:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788875247.988371:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788875247.988473:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788875247.988482:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788875247.988599:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875247.988823:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875247.988867:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875247.989366:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100032 00000100:00100000:2.0:1788875247.989375:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100032 00000100:00100000:2.0:1788875247.989440:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788875247.989451:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875247.989886:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100032:12345-0@lo:501:mount.lustre.0 Request processed in 435us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875247.989893:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788875247.990073:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875247.990195:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788875247.990236:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875247.990262:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:2.0:1788875247.990306:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100160 00000100:00100000:2.0:1788875247.990311:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100160 00000100:00100000:2.0:1788875247.990375:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788875247.990384:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0293d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875247.990547:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0293d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100160:12345-0@lo:503:mount.lustre.0 Request processed in 163us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875247.990554:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788875247.990628:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788875247.991471:0:15169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788875247.991540:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875247.991583:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875247.995872:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876180 going to sleep for 11 seconds 00000100:00100000:0.0:1788875248.001899:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100288 00000100:00100000:0.0:1788875248.001916:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100288 00000100:00100000:0.0:1788875248.001967:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788875248.001977:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788875248.002307:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100288:12345-0@lo:502:mount.lustre.0 Request processed in 330us (10721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875248.002316:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788875248.006353:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788875248.006925:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788875248.006995:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788875248.007038:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788875248.007084:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788875248.007135:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788875248.007183:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788875248.007233:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788875248.007266:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788875248.007311:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788875248.007347:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788875248.007381:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788875248.007469:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788875248.007508:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788875248.007542:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788875248.007588:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788875248.007641:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788875248.007988:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788875248.008040:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788875248.008076:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788875248.008177:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788875248.008227:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788875248.008263:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788875248.008298:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788875248.008346:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788875248.008383:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788875248.008430:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788875248.008479:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788875248.008532:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788875248.008562:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788875248.008605:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788875248.010258:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788875248.010303:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788875248.010334:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788875248.010427:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788875248.010467:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788875248.010515:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788875248.010553:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788875248.010584:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788875248.015561:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788875248.017893:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788875248.017965:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875248.018069:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875248.018233:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a35876f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788875248.018945:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100416 00000100:00100000:0.0:1788875248.018955:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100416 00000100:00100000:0.0:1788875248.019021:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788875248.019031:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788875248.019316:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100416:12345-0@lo:502:mount.lustre.0 Request processed in 286us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875248.019324:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788875248.021527:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788875248.021702:0:15169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788875248.021717:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788875248.025022:0:15192:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788875248.025041:0:15192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e5a0472cd40) 00000020:00000080:1.0:1788875248.025062:0:15192:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788875248.025270:0:15192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a06642800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788875248.025274:0:15192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a06642800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788875248.025277:0:15192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a06642800 3 00010000:00080000:1.0:1788875248.025308:0:15192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5904cc9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1788875248.042357:0:15192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788875248.042604:0:15192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788875248.042645:0:15192:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788875248.042672:0:15192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x60858e6020d833a5 00000100:00080000:3.0:1788875248.042684:0:15192:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788875248.042690:0:15192:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5904cc9800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1788875248.042725:0:15192:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3cd8a680 x1875771241100544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788875248.042752:0:15192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788875248.042922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875248.042935:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788875248.042937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875248.042940:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788875248.042998:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875248.043012:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241100672:0@lo:400:kworker.0 00000100:00100000:2.0:1788875248.043075:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875248.043224:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241100544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788875248.043259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875248.046692:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100672 00000100:00100000:2.0:1788875248.046706:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100672 00000100:00100000:2.0:1788875248.046753:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100544 00000100:00100000:2.0:1788875248.046757:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100544 00000100:00100000:2.0:1788875248.046793:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788875248.046803:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241100672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875248.046895:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241100672:12345-0@lo:400:kworker.0 Request processed in 94us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875248.046903:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788875248.046920:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788875248.046924:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875771241100544:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788875248.046945:0:14488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1788875248.046986:0:14488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x60858e6020d833ac 00000004:00100000:2.0:1788875248.047002:0:14488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788875248.047036:0:14488:0:(import.c:65:import_set_state_nolock()) ffff9e5906036000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875248.047078:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875771241100544:12345-0@lo:38:llog_process_th.0 Request processed in 151us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875248.047084:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788875248.047139:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a3fd48000 x1875771241100672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875248.047165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241100672:0@lo:400:kworker.0 00010000:00080000:0.0:1788875248.047915:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5a3cd8a680 x1875771241100544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788875258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875248.047926:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788875248.047933:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788875248.047941:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788875248.047946:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788875248.047948:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5904cc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788875248.047954:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875771241100544:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788875248.052485:0:15192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788875248.060479:0:15169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788875248.060543:0:15169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788875248.060570:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83397 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875248.060584:0:15169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c45400/0x60858e6020d83390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83397 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788875248.060643:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788875248.060646:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875248.060647:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875248.060649:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875248.060650:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875248.060652:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875248.060654:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875248.060656:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875248.060657:0:15169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788875248.060661:0:15169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788875248.060664:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788875248.060666:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875248.060667:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875248.060668:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875248.060669:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875248.060670:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875248.060671:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875248.060672:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875248.060673:0:15169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788875248.060705:0:15169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788875248.060727:0:15169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788875248.060838:0:15169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875248.060885:0:15169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a051acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788875248.062619:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100800 00000100:00100000:0.0:1788875248.062633:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100800 00000100:00100000:0.0:1788875248.062701:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788875248.062710:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+16:15169:x1875771241100800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788875248.062741:0:14482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788875248.062756:0:14482:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788875248.109595:0:14482:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788875248.109607:0:14482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788875248.109713:0:14504:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788875248.109720:0:14504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788875248.109755:0:14504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.109801:0:14504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83319 expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.109811:0:14504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.109852:0:14504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.109868:0:14504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 16 pid: 14481 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875248.109883:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241100928:0@lo:104: 00000100:00100000:0.0:1788875248.109949:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875248.110009:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a373c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788875248.110133:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241100928 00000100:00100000:3.0:1788875248.110143:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241100928 00000100:00100000:3.0:1788875248.110196:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788875248.110215:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241100928:12345-0@lo:104: 00010000:00010000:3.0:1788875248.110228:0:14471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.110286:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788875248.110293:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241100928:12345-0@lo:104: Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875248.110299:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788875248.110440:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875248.110446:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.110454:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34e00 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788875248.110457:0:14477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.110465:0:14477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788875248.110471:0:14477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875248.110487:0:14477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788875248.110524:0:14477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.110531:0:14477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788875248.110551:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.110559:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34e00/0x60858e6020d83319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83320 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875248.110576:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875248.110577:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875248.110579:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875248.110844:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241100928:0@lo:104: 00010000:00010000:1.0:1788875248.110865:0:14504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875248.111609:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875248.111670:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875248.111812:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101056 00000100:00100000:3.0:1788875248.111819:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101056 00010000:00010000:3.0:1788875248.111849:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 17 pid: 14481 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875248.111891:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788875248.111900:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+17:3303:x1875771241101056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875248.111914:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875248.111920:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 17 pid: 14481 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.111931:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 17 pid: 14481 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.111945:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14200/0x60858e6020d83320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d83319 expref: 17 pid: 14481 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.111959:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.111967:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788875248.111995:0:14473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005531594s 00010000:00010000:3.0:1788875248.111999:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112006:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112014:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112020:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112032:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875248.112037:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112045:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112061:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875248.112071:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875248.112116:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241101056:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875248.112123:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788875248.112453:0:14504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875248.112462:0:14504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875248.112468:0:14504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee0600/0x60858e6020d833b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875248.112547:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875248.122189:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+15:15169:x1875771241100800:12345-0@lo:253:mount.lustre.0 Request processed in 59470us (61341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875248.122218:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788875248.122393:0:15169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15169:1875771241100800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788875248.122412:0:15169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788875248.122424:0:15169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788875248.122426:0:15169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788875248.122427:0:15169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875248.122428:0:15169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875248.122429:0:15169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875248.122431:0:15169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875248.122433:0:15169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875248.122435:0:15169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875248.122436:0:15169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788875248.122450:0:15169:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788875248.130073:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875248.130399:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788875248.130586:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875248.130735:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788875248.131357:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788875248.131599:0:15169:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788875248.132545:0:15169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788875248.248888:0:15169:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788875248.248897:0:15169:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788875248.249346:0:15169:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788875248.249420:0:15169:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788875248.249435:0:15169:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788875248.249468:0:15169:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788875248.273230:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875249.293883:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788875249.293948:0:14485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788875249.293959:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e59064ff800 from 7 10000000:01000000:3.0:1788875249.293964:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788875249.294007:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875249.294018:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875249.294031:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875249.294058:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241101184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788875249.294131:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875249.294187:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048bef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788875249.294237:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101184 00000100:00100000:0.0:1788875249.294245:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101184 00000100:00100000:0.0:1788875249.294297:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788875249.294307:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+15:14485:x1875771241101184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875249.294322:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875249.294336:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d833ba expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875249.294360:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d833ba expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875249.294370:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d833ba expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875249.294391:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0e00, rc 0) 00000100:00100000:0.0:1788875249.294447:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:14485:x1875771241101184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875249.294454:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788875249.294499:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241101184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875249.294512:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875249.294521:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875249.294566:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241101312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788875249.294595:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875249.294607:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a373c9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788875249.294654:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101312 00000100:00100000:3.0:1788875249.294659:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101312 00000100:00100000:3.0:1788875249.294692:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788875249.294698:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:14485:x1875771241101312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788875249.294711:0:14483:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788875249.294727:0:14483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788875249.294730:0:14483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788875249.294832:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:14485:x1875771241101312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875249.294839:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788875249.297096:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241101312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788875249.297176:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788875249.297186:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875249.297204:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875250.319148:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875251.342155:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875252.370323:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788875253.071204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788875253.071213:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788875253.071216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788875253.071231:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788875253.071280:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875253.071303:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101440:0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875253.071434:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241101568:0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875253.071489:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875253.071494:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241101696:0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875253.071553:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101440 00000100:00100000:1.0:1788875253.071562:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101440 00000100:00100000:1.0:1788875253.071623:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788875253.071633:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241101440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071682:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241101440:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875253.071690:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788875253.071724:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101568 00000100:00100000:1.0:1788875253.071728:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101568 00000100:00100000:1.0:1788875253.071753:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101696 00000100:00100000:1.0:1788875253.071756:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101696 00000100:00100000:1.0:1788875253.071809:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788875253.071814:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241101568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071849:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241101568:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875253.071855:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788875253.071866:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788875253.071879:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241101696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.071905:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241101696:12345-0@lo:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875253.071910:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788875253.071950:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a355e2680 x1875771241101696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875253.071964:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241101696:0@lo:400:kworker.0 00010000:00080000:1.0:1788875253.071973:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a355e3100 x1875771241101568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875253.071981:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241101568:0@lo:400:kworker.0 00000100:00100000:1.0:1788875253.072005:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101440:0@lo:400:kworker.0 00000100:00080000:3.0:1788875253.072931:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788875253.389961:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788875253.906236:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788875254.414442:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788875255.311360:0:15538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788875255.441959:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875256.271630:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875241/real 1788875241] req@ffff9e5a355e1180 x1875771241097344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875256.271692:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a355e1180 x1875771241097344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875256.271704:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788875241/real 1788875241] req@ffff9e5a355e3480 x1875771241097472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875256 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875256.271717:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5a355e3480 x1875771241097472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788875256 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788875256.271738:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a37384000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788875256.271763:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788875256.271768:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241097344:0@lo:8:kworker.0 00000100:00080000:3.0:1788875256.271802:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788875256.271808:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788875256.271811:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241097472:0@lo:8:kworker.0 00000100:00080000:0.0:1788875256.271989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788875256.272001:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788875256.272004:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a37384000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788875256.272008:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1788875256.272014:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788875256.272021:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5a37384000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875256.272044:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288a80 x1875771241101952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788875256.272070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788875256.272073:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788875256.272075:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788875256.272078:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1788875256.272080:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788875256.272084:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875256.272095:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3628bb80 x1875771241102080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788875256.272141:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241101952:0@lo:8:kworker.0 00000100:00100000:0.0:1788875256.272216:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875256.272439:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241102208:0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.272452:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101824:0@lo:400:kworker.0 00000100:00100000:3.0:1788875256.272473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875256.272482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875256.272531:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241102336:0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.272558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875256.272604:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102208 00000100:00100000:1.0:1788875256.272612:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102208 00000100:00100000:1.0:1788875256.272674:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102336 00000100:00100000:1.0:1788875256.272678:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102336 00000100:00100000:1.0:1788875256.272711:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788875256.272720:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241102208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.272769:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241102208:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875256.272810:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788875256.272825:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875256.272831:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241102336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.272864:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241102336:12345-0@lo:400:kworker.0 Request processed in 33us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875256.272870:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875256.272885:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101824 00000100:00100000:1.0:1788875256.272888:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101824 00000100:00100000:1.0:1788875256.272907:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788875256.272913:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241101824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.272940:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241101824:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875256.272946:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788875256.277162:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788875256.277224:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a36289c00 x1875771241102208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875256.277254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241102208:0@lo:400:kworker.0 00010000:00080000:1.0:1788875256.277437:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a36289f80 x1875771241102336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875256.277448:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241102336:0@lo:400:kworker.0 00000100:00100000:1.0:1788875256.277475:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241101824:0@lo:400:kworker.0 00000100:00100000:0.0:1788875256.278710:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241102080:0@lo:8:kworker.0 00000100:00100000:0.0:1788875256.278790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875256.279851:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241101952 00000100:00100000:3.0:1788875256.279863:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241101952 00000100:00100000:3.0:1788875256.279895:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102080 00000100:00100000:3.0:1788875256.279898:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102080 00000100:00100000:3.0:1788875256.279912:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875256.279919:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241101952:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788875256.279949:0:15170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:3.0:1788875256.279990:0:15170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d833c8 00002000:00100000:3.0:1788875256.280004:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e5a35a8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788875256.280012:0:15170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788875256.280015:0:15170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788875256.280535:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788875256.280563:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e5a35a8e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788875256.280655:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875771241101952:12345-0@lo:8:kworker.0 Request processed in 735us (8439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875256.280826:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788875256.280869:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875256.280875:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241102080:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788875256.280889:0:15170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788875256.280920:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241102080:12345-0@lo:8:kworker.0 Request processed in 44us (2148us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788875256.280926:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788875256.280973:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a36288a80 x1875771241101952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788875276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875256.280985:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788875256.280992:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788875256.281000:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788875256.281005:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788875256.281008:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a37384000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788875256.281024:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788875256.281029:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241101952:0@lo:8:kworker.0 00000100:00080000:3.0:1788875256.281045:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788875256.281049:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788875256.281052:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241102080:0@lo:8:kworker.0 00000004:00080000:1.0:1788875256.281313:0:14511:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788875256.281334:0:14511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14511:1875771241102592:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788875256.281390:0:14511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875256.281411:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241102464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875256.281412:0:14511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415480 going to sleep for 11 seconds 00000100:00100000:3.0:1788875256.281439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875256.281876:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102592 00000100:00100000:3.0:1788875256.281884:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102592 00000100:00100000:3.0:1788875256.281931:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788875256.281939:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14511:x1875771241102592:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788875256.284318:0:14510:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788875256.285605:0:14510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471150830884ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788875256.285663:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102464 00000100:00100000:2.0:1788875256.285674:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102464 00000100:00100000:2.0:1788875256.287941:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788875256.287954:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241102464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875256.287992:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788875256.288310:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788875256.288734:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875771241102464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 782us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875256.288744:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788875256.289205:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a355e3100 x1875771241102464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788875256.289228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241102464:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788875256.291891:0:15171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788875256.291902:0:15171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788875256.292037:0:15171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788875256.313099:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.313114:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313132:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.313137:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.313144:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313161:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313171:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313179:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313201:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875256.313250:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.313258:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.313266:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.313271:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.313281:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.313308:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.313315:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c210b5/0x60858e6020d833cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.313354:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.313356:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.313358:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.313886:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.313900:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313910:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.313913:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.313917:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313926:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313933:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313941:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.313965:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875256.313994:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.314000:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.314008:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.314012:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.314031:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.314042:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.314050:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc0c848/0x60858e6020d833d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.314062:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.314064:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.314066:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.314429:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.314435:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.314444:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.314447:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.314451:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.314460:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.314474:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.314481:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.314502:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875256.316055:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.316066:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.316097:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.316102:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.316113:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.316132:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.316140:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064301bf/0x60858e6020d833dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.316165:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.316167:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.316169:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.321563:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.321579:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.321597:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.321602:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.321609:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.321624:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.321635:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.321644:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.321680:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875256.321842:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.321849:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.321856:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.321860:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.321870:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.321895:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.321914:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d38fd8/0x60858e6020d833e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.321932:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.321934:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.321936:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.333844:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.333858:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.333876:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.333880:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.333887:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.333901:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.333912:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.333919:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.333950:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788875256.334463:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.334469:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.334478:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.334487:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.334491:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.334501:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.334509:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.334516:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.343104:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788875256.343872:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.343882:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.343898:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.343903:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.343910:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.343926:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.343937:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.343954:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353431:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788875256.353446:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353468:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.353474:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353486:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353510:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353519:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb4dcf3/0x60858e6020d833eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353614:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875256.353619:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353626:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.353629:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353637:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353647:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353661:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75bc500/0x60858e6020d833f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353675:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.353678:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353684:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.353687:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353695:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353705:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.353712:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.353714:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.353716:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875256.353888:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788875256.353897:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002744132e/0x60858e6020d833f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788875256.354614:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.354622:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.354635:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.354639:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.354645:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.354657:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.354665:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.354672:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.354692:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788875256.355163:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.355168:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355174:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.355176:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.355179:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355185:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355190:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355195:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355200:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788875256.355667:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.355671:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355676:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.355683:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.355686:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355693:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355698:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355702:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.355707:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788875256.356096:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.356101:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356107:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.356110:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.356115:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356124:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356133:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356147:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356158:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788875256.356696:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.356702:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356708:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.356710:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.356713:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356719:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356725:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356729:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.356734:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788875256.357111:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.357117:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.357130:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.357133:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.357136:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.357146:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.357154:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.357162:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.357171:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788875256.357463:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788875256.357470:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357477:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b35000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357484:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357491:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357504:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357509:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a020d748/0x60858e6020d83400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357524:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788875256.357527:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357531:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357533:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357537:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357542:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357545:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007847672e/0x60858e6020d83407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357560:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788875256.357564:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357570:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357573:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357580:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357590:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357597:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063d2d171/0x60858e6020d8340e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357609:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788875256.357613:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357619:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357621:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357634:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357641:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357645:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c4e250/0x60858e6020d83415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357653:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875256.357655:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357658:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357660:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357664:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357669:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357673:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d10dab8/0x60858e6020d8341c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357685:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.357687:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357691:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.357693:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357697:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357702:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357706:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f86158f2/0x60858e6020d83423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.357711:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.357712:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.357714:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.366627:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.369735:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.369750:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.369802:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.369809:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.369816:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.369833:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.369856:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.369864:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.369882:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.370052:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.370061:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.370069:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.370080:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.370090:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.370107:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.370115:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb39a820/0x60858e6020d8342a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.370134:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.370136:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.370138:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.370746:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.370754:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.370861:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.370881:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.370891:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.370903:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.370912:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.370920:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.371229:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788875256.372918:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.373351:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.373522:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.373539:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.373547:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.373563:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.373574:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.373582:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.377242:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788875256.377254:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788875256.377266:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377281:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.377287:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377301:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377323:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377713:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe6d49d/0x60858e6020d83431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788875256.377746:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788875256.377869:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.377874:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377882:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.377884:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377890:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377898:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377903:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c8f270/0x60858e6020d83438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.377915:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.377916:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.377918:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.378041:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.378050:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378064:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.378074:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.378081:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378096:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378105:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378112:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378132:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.378145:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.378152:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378166:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.378169:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378177:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378189:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378197:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfcfcbf1/0x60858e6020d8343f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378215:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.378218:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.378220:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.378569:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.378576:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378585:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.378589:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.378592:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378603:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378611:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378626:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.378645:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.378660:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.378667:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378676:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.378680:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378690:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378709:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378717:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003eb7378/0x60858e6020d83446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.378733:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.378735:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.378737:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.379096:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.379102:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379112:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.379115:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.379119:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379129:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379137:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379144:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379159:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.379193:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.379199:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379207:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.379210:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379219:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379230:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379238:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0aa749f/0x60858e6020d8344d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379265:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.379267:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.379270:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.379560:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.379566:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379579:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.379582:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.379586:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379596:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379604:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379611:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.379633:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.379869:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.379876:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379884:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.379888:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379898:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379909:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379916:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9a1ad0/0x60858e6020d83454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.379932:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.379934:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.379935:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.380129:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.380136:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.380143:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.380146:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.380151:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.380159:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.380180:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.380186:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.380209:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.380262:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.380268:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.380287:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.380291:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.380300:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.380312:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.380319:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f13889/0x60858e6020d8345b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.380345:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.380347:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.380349:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.381856:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.385604:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.385617:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.385636:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.385641:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.385647:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.385662:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.385672:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.385681:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.385724:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.385877:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.385886:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.385896:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.385901:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.385912:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.385937:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.385945:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da963902/0x60858e6020d83462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.385963:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.385965:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.385967:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.386662:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.386671:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.386682:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.386686:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.386691:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.386703:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.386712:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.386719:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.386740:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875256.386849:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875256.386856:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.386864:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875256.386869:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.386883:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.386897:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.386905:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b7d30e5/0x60858e6020d83469 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.387263:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875256.387267:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875256.387270:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.392682:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.392697:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.392717:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.392733:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.392739:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.392755:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.392767:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.392805:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.392839:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.393593:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.393601:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.393611:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.393616:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.393625:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.393643:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.393651:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f50e0321/0x60858e6020d83470 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.393688:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.393690:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.393692:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788875256.397730:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788875256.397743:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.397760:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788875256.397765:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875256.399859:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.399891:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.399903:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.399918:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875256.401887:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788875256.401913:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.401924:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.401936:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.401942:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.401954:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.401977:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.401986:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030e50566/0x60858e6020d83477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.402020:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.402023:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.402025:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.413048:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.413059:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.413077:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.413082:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.413088:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.413104:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.413114:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.413133:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.413158:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875256.413882:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875256.413891:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.413901:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875256.413907:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.413918:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.413936:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.413944:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb636b71/0x60858e6020d8347e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875256.413961:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.413963:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875256.413965:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788875256.417359:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788875256.417372:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.417391:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788875256.417396:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875256.417402:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.417417:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.417427:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.417436:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875256.417465:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788875256.417761:0:15171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788875256.417874:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14511:x1875771241102592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 135933us (136479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875256.417892:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788875256.420352:0:14511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14511:1875771241102592:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788875256.420409:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875256.420420:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.420433:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875256.420439:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.420449:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.420470:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.420479:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067aed109/0x60858e6020d83485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875256.420505:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.420507:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875256.420509:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788875256.421008:0:14511:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788875256.421076:0:14511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14511:1875771241102720:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788875256.421131:0:14511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875256.421178:0:14511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415480 going to sleep for 11 seconds 00000100:00100000:1.0:1788875256.422036:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102720 00000100:00100000:1.0:1788875256.422047:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102720 00000100:00100000:3.0:1788875256.422152:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875256.422163:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14511:x1875771241102720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788875256.422221:0:15171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788875256.436271:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14511:x1875771241102720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14103us (15132us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788875256.436370:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788875256.441965:0:14511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14511:1875771241102720:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788875256.441985:0:14511:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788875256.463421:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875257.486104:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875258.513619:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788875258.789382:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788875258.789394:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788875259.534256:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875260.560168:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875261.585552:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875261.774901:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241102848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788875261.774940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875261.774956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788875261.774959:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788875261.774964:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1788875261.774969:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788875261.774974:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875261.774983:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875261.774995:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3fd4b100 x1875771241103232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788875261.775039:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241103488:0@lo:400:kworker.0 00000100:00100000:0.0:1788875261.775065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875261.775098:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788875261.775103:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241102976:0@lo:400:kworker.0 00000100:00100000:3.0:1788875261.775104:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241103232:0@lo:8:kworker.0 00000100:00100000:3.0:1788875261.775130:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875261.775130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875261.775195:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102848 00000100:00100000:0.0:1788875261.775202:0:15175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102848 00000100:00100000:0.0:1788875261.775249:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788875261.775258:0:15175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241102848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875261.775302:0:15175:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875261.775344:0:15175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241102848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875261.775351:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788875261.775387:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788875261.775408:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241102848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875261.776077:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103488 00000100:00100000:2.0:1788875261.776083:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103488 00000100:00100000:2.0:1788875261.776127:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788875261.776136:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875261.776195:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241103488:12345-0@lo:400:kworker.0 Request processed in 60us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875261.776202:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788875261.776818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a3fd4ad80 x1875771241103488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875261.776833:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241103488:0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.777507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241103104:0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.777565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875261.777607:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788875261.777615:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241103360:0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.777638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875261.777672:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241102976 00000100:00100000:1.0:1788875261.777678:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241102976 00000100:00100000:1.0:1788875261.777716:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788875261.777724:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241102976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.777791:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+16:3303:x1875771241102976:12345-0@lo:400:kworker.0 Request processed in 49us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875261.777799:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788875261.777831:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103232 00000100:00100000:1.0:1788875261.777835:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103232 00000100:00100000:1.0:1788875261.777863:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103104 00000100:00100000:1.0:1788875261.777866:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103104 00000100:00100000:1.0:1788875261.777885:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788875261.777891:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241103104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.777928:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241103104:12345-0@lo:400:kworker.0 Request processed in 36us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875261.777934:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788875261.777946:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788875261.777949:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241103232:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788875261.777967:0:15170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788875261.779867:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103360 00000100:00100000:2.0:1788875261.779881:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103360 00000100:00100000:2.0:1788875261.779940:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788875261.779950:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875261.780042:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241103360:12345-0@lo:400:kworker.0 Request processed in 93us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875261.780050:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788875261.780088:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788875261.780094:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788875261.796232:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a3fd49c00 x1875771241103360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875261.796253:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241103360:0@lo:400:kworker.0 00000100:00100000:0.0:1788875261.796269:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241103104:0@lo:400:kworker.0 00000100:00100000:0.0:1788875261.796321:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241102976:0@lo:400:kworker.0 00000100:00100000:1.0:1788875261.806678:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241103232:12345-0@lo:8:kworker.0 Request processed in 28714us (31533us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788875261.806693:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788875261.806749:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788875261.806754:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788875261.806758:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241103232:0@lo:8:kworker.0 00000020:01000004:3.0:1788875262.139124:0:15891:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788875262.139128:0:15891:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788875262.139253:0:15891:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5a3f777800 00000020:01000004:3.0:1788875262.139272:0:15891:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788875262.139296:0:15891:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788875262.139337:0:15891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e5907c53380) 00000020:00000080:3.0:1788875262.139359:0:15891:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788875262.162201:0:15891:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788875262.163008:0:15891:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788875262.163730:0:15891:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788875262.164261:0:15891:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788875262.164500:0:15891:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788875262.164868:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:2.0:1788875262.164996:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:2.0:1788875262.165085:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:2.0:1788875262.165488:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1788875262.167269:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1788875262.167641:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1788875262.167915:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1788875262.168156:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1788875262.168413:0:15891:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00000020:00000080:2.0:1788875262.169594:0:15891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788875262.169607:0:15891:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788875262.169618:0:15891:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x60858e6020d83493 00000020:01000004:2.0:1788875262.169626:0:15891:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788875262.169646:0:15891:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.107@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788875262.169649:0:15891:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788875262.169655:0:15891:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788875262.169678:0:15891:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788875262.169682:0:15891:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.107@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788875262.177195:0:15891:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788875262.177234:0:15891:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.107@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788875262.177238:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788875262.177239:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788875262.177240:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875262.177241:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875262.177242:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875262.177242:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875262.177243:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875262.177244:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875262.177248:0:15891:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875262.177251:0:15891:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788875262.177253:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788875262.177254:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788875262.177254:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875262.177255:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875262.177255:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875262.177256:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875262.177257:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875262.177257:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875262.177258:0:15891:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788875262.177294:0:15891:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788875262.177311:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788875262.177368:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.177417:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048be480 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.177542:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103616 00000100:00100000:1.0:1788875262.177550:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103616 00000100:00100000:1.0:1788875262.177601:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788875262.177608:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15891:x1875771241103616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788875262.177636:0:14483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788875262.177638:0:14483:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788875262.177641:0:14483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788875262.183680:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:15891:x1875771241103616:12345-0@lo:253:mount.lustre.0 Request processed in 6061us (6299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.183696:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788875262.183814:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788875262.183831:0:15891:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788875262.183835:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788875262.183836:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788875262.183838:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788875262.183839:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788875262.183840:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788875262.183842:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788875262.183843:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788875262.183845:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788875262.183846:0:15891:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788875262.183868:0:15891:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5a3f777800 from lustre-OST0001 10000000:01000000:2.0:1788875262.183897:0:15891:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788875262.183901:0:15891:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788875262.183909:0:15891:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e5a362bcd40 local copy 00010000:00010000:2.0:1788875262.183920:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875262.184211:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875262.184256:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.184539:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.184592:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103744 00000100:00100000:1.0:1788875262.184599:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103744 00000100:00100000:1.0:1788875262.184681:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788875262.184692:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:15891:x1875771241103744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875262.185018:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:15891:x1875771241103744:12345-0@lo:501:mount.lustre.0 Request processed in 328us (761us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788875262.185027:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788875262.185179:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103744:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788875262.185195:0:15891:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788875262.185365:0:15891:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788875262.185373:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.185383:0:15891:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14a00/0x60858e6020d83240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83247 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875262.185407:0:15891:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5a3f777800 10000000:01000000:0.0:1788875262.185412:0:15891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788875262.185417:0:15891:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788875262.185419:0:15891:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788875262.185423:0:15891:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788875262.185426:0:15891:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788875262.185451:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.185460:0:15891:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.185479:0:15891:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875262.185495:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788875262.185524:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.185595:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.185639:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241103872 00000100:00100000:1.0:1788875262.185644:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241103872 00000100:00100000:1.0:1788875262.185679:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788875262.185687:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:15891:x1875771241103872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788875262.185698:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875262.185711:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a19e00/0x60858e6020d834a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8349a expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875262.185732:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a19e00/0x60858e6020d834a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8349a expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875262.185743:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a19e00/0x60858e6020d834a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8349a expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875262.185752:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19e00, rc 0) 00000100:00100000:1.0:1788875262.185805:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241103872:12345-0@lo:101:mount.lustre.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.185811:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788875262.185929:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241103872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788875262.185943:0:15891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834a1 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.185952:0:15891:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d834a1 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875262.186511:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788875262.187389:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788875262.187616:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788875262.187659:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788875262.187687:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788875262.187732:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788875262.187768:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788875262.187863:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788875262.187927:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788875262.187936:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788875262.188017:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788875262.188078:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.188112:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.188496:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104000 00000100:00100000:1.0:1788875262.188507:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104000 00000100:00100000:1.0:1788875262.188560:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788875262.188573:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875262.189202:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104000:12345-0@lo:501:mount.lustre.0 Request processed in 631us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.189211:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788875262.190243:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788875262.190311:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788875262.190375:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.190416:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.190482:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104128 00000100:00100000:2.0:1788875262.190490:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104128 00000100:00100000:2.0:1788875262.190540:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788875262.190549:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875262.190886:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104128:12345-0@lo:503:mount.lustre.0 Request processed in 338us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.190893:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788875262.191052:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788875262.191684:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788875262.191749:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875262.192220:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.192366:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875262.195254:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104256 00000100:00100000:0.0:1788875262.195270:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104256 00000100:00100000:0.0:1788875262.195380:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788875262.195391:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788875262.195753:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104256:12345-0@lo:502:mount.lustre.0 Request processed in 364us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.195761:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788875262.196096:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788875262.196368:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788875262.196423:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788875262.196459:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788875262.196507:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788875262.196544:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788875262.196577:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788875262.196627:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788875262.196663:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788875262.196707:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788875262.196747:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875262.197055:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.197130:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.197178:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104384 00000100:00100000:1.0:1788875262.197184:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104384 00000100:00100000:1.0:1788875262.197256:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788875262.197266:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788875262.197458:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104384:12345-0@lo:502:mount.lustre.0 Request processed in 193us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.197465:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788875262.197540:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788875262.197612:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788875262.197623:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788875262.199070:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788875262.199080:0:15892:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788875262.199086:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.199088:0:15892:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788875262.199094:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788875262.199110:0:15892:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e5907c54d40) 00000020:00000080:3.0:1788875262.199151:0:15892:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788875262.199158:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788875262.199224:0:15892:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a3f777800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788875262.199232:0:15892:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788875262.199239:0:15892:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x60858e6020d834af 00010000:00010000:3.0:1788875262.203431:0:15892:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788875262.203882:0:15892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788875262.205350:0:15892:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788875262.207379:0:15892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788875262.207390:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788875262.207398:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.207401:0:15892:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788875262.207404:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788875262.207408:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.207410:0:15892:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788875262.207413:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788875262.207415:0:15892:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788875262.207418:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788875262.207420:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.207422:0:15892:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788875262.207424:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788875262.207427:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.207428:0:15892:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788875262.207431:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788875262.207482:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788875262.207485:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788875262.207487:0:15892:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788875262.207490:0:15892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788875262.209104:0:15891:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788875262.209141:0:15891:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788875262.209158:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834a1 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209170:0:15891:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0000/0x60858e6020d8349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834a1 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875262.209204:0:15891:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a3f777800 from 1 10000000:01000000:0.0:1788875262.209208:0:15891:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788875262.209249:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209259:0:15891:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209270:0:15891:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875262.209306:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788875262.209374:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.209412:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104512 00000100:00100000:0.0:1788875262.209418:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104512 00000100:00100000:0.0:1788875262.209462:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788875262.209479:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+17:15891:x1875771241104512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788875262.209491:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875262.209503:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d834b6 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209526:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209537:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209546:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1400, rc 0) 00000100:00100000:0.0:1788875262.209579:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104512:12345-0@lo:101:mount.lustre.0 Request processed in 101us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.209586:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788875262.209627:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788875262.209651:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788875262.209666:0:15891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.209675:0:15891:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875262.211325:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788875262.211865:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788875262.214936:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788875262.215134:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788875262.215216:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788875262.215224:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788875262.215349:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788875262.215425:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.215471:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.215550:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104640 00000100:00100000:1.0:1788875262.215559:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104640 00000100:00100000:1.0:1788875262.215608:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788875262.215618:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875262.215881:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104640:12345-0@lo:501:mount.lustre.0 Request processed in 264us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.215889:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788875262.215989:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875262.216026:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875262.216066:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.216092:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104768 00000100:00100000:2.0:1788875262.216097:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104768 00000100:00100000:2.0:1788875262.216130:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788875262.216137:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875262.216427:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104768:12345-0@lo:503:mount.lustre.0 Request processed in 289us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.216435:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788875262.216466:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.216478:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788875262.217124:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788875262.217192:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.217237:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.217272:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241104896 00000100:00100000:2.0:1788875262.217296:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241104896 00000100:00100000:2.0:1788875262.217320:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788875262.217326:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.217485:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241104896:12345-0@lo:502:mount.lustre.0 Request processed in 158us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.217493:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788875262.217525:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.217537:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241104896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788875262.217732:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788875262.217799:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788875262.217863:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788875262.217901:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788875262.217935:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788875262.217980:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788875262.218013:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788875262.218042:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788875262.218066:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.218103:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.218132:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105024 00000100:00100000:2.0:1788875262.218137:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105024 00000100:00100000:2.0:1788875262.218157:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788875262.218163:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241105024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.218294:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241105024:12345-0@lo:502:mount.lustre.0 Request processed in 117us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.218301:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788875262.218333:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a048be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.218345:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788875262.218421:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788875262.218430:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788875262.223901:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875262.223919:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.223922:0:15896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788875262.223929:0:15896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a3f777800 00000020:00000080:0.0:1788875262.223931:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788875262.223940:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875262.223942:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.223943:0:15896:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788875262.223945:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875262.223948:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.223949:0:15896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788875262.223952:0:15896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5a3f777800 00000020:00000080:0.0:1788875262.223953:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788875262.224355:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875262.224360:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.224361:0:15896:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788875262.224365:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788875262.224367:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.224369:0:15896:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788875262.224373:0:15896:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5a3f777800 00000020:00000080:0.0:1788875262.224375:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788875262.226148:0:15896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788875262.226158:0:15896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788875262.226161:0:15896:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788875262.226165:0:15896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788875262.232074:0:15891:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788875262.232118:0:15891:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788875262.234934:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.234953:0:15891:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788875262.248118:0:15891:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788875262.248127:0:15891:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5a3f777800 10000000:01000000:2.0:1788875262.248131:0:15891:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5a3f777800 10000000:01000000:2.0:1788875262.248136:0:15891:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788875262.248144:0:15891:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5a3f777800 from 1 10000000:01000000:2.0:1788875262.248147:0:15891:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788875262.248190:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248202:0:15891:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248214:0:15891:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875262.248237:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788875262.248316:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.248354:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105152 00000100:00100000:2.0:1788875262.248361:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105152 00000100:00100000:2.0:1788875262.248403:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788875262.248420:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241105152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875262.248435:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875262.248446:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35c45600/0x60858e6020d834cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d834c4 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248468:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35c45600/0x60858e6020d834cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d834c4 expref: 19 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248479:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35c45600/0x60858e6020d834cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d834c4 expref: 19 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248502:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c45600, rc 0) 00000100:00100000:2.0:1788875262.248536:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105152:12345-0@lo:101:mount.lustre.0 Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.248543:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788875262.248585:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.248609:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788875262.248623:0:15891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834cb expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875262.248632:0:15891:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d834cb expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788875262.249648:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788875262.251878:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788875262.252432:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788875262.252480:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788875262.252513:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788875262.252562:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788875262.252609:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788875262.252653:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788875262.252703:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788875262.252733:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788875262.255091:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788875262.255186:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788875262.255223:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788875262.255299:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788875262.255336:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788875262.255366:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788875262.255409:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788875262.255442:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788875262.255475:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788875262.255520:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788875262.255556:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788875262.255592:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788875262.255641:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788875262.255703:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788875262.255757:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788875262.255823:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788875262.255857:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788875262.255888:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788875262.255931:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788875262.259505:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788875262.259612:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788875262.259690:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788875262.259727:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788875262.259759:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788875262.259810:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788875262.259860:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788875262.259895:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788875262.259940:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788875262.260044:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788875262.260155:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788875262.260164:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788875262.260265:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875262.260343:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.260384:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.261189:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105280 00000100:00100000:1.0:1788875262.261199:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105280 00000100:00100000:1.0:1788875262.261245:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788875262.261255:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788875262.261522:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105280:12345-0@lo:501:mount.lustre.0 Request processed in 267us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.261530:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788875262.261675:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788875262.261716:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788875262.261756:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875262.261812:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875262.262252:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105408 00000100:00100000:1.0:1788875262.262258:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105408 00000100:00100000:1.0:1788875262.262303:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788875262.262310:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788875262.262617:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105408:12345-0@lo:503:mount.lustre.0 Request processed in 306us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875262.262624:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788875262.262713:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788875262.263351:0:15891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788875262.263428:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875262.263477:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.263501:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.263591:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105536 00000100:00100000:2.0:1788875262.263597:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105536 00000100:00100000:2.0:1788875262.263631:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788875262.263640:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.263927:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105536:12345-0@lo:502:mount.lustre.0 Request processed in 287us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.263935:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788875262.264070:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788875262.264621:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788875262.264676:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788875262.264710:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788875262.264758:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788875262.264839:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788875262.264890:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788875262.264927:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788875262.264956:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788875262.265148:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788875262.265186:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788875262.265221:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788875262.265300:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788875262.265337:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788875262.265372:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788875262.265419:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788875262.265456:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788875262.265488:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788875262.265538:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788875262.265575:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788875262.265608:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788875262.265653:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788875262.265687:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788875262.265715:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788875262.265760:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788875262.266928:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788875262.266982:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788875262.267042:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788875262.267098:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788875262.267132:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788875262.267181:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788875262.267218:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788875262.267253:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788875262.267300:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788875262.267351:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788875262.267388:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788875262.267437:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788875262.267473:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788875262.267519:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788875262.267569:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788875262.267606:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788875262.267660:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788875262.267737:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.267927:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788875262.270197:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105664 00000100:00100000:2.0:1788875262.270215:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105664 00000100:00100000:2.0:1788875262.270288:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788875262.270300:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788875262.274675:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241105664:12345-0@lo:502:mount.lustre.0 Request processed in 4368us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875262.274689:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788875262.274844:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241105664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788875262.275312:0:15891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788875262.275328:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788875262.281611:0:15901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788875262.281630:0:15901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e5a362b8000) 00000020:00000080:2.0:1788875262.281654:0:15901:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788875262.281753:0:15901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5a3f777800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788875262.281758:0:15901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5a3f777800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788875262.281761:0:15901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5a3f777800 3 00010000:00080000:2.0:1788875262.281922:0:15901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e59065c3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.107@tcp at head 00010000:00010000:3.0:1788875262.288180:0:15901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788875262.288416:0:15901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788875262.288459:0:15901:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788875262.288473:0:15901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x60858e6020d834d9 00000100:00080000:3.0:1788875262.288484:0:15901:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788875262.288491:0:15901:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e59065c3000 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:3.0:1788875262.288530:0:15901:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3cd88700 x1875771241105792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788875262.288559:0:15901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788875262.291808:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241105792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788875262.291895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.292299:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105792 00000100:00100000:0.0:1788875262.292307:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105792 00000100:00100000:0.0:1788875262.292350:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788875262.292358:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875771241105792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788875262.292397:0:14490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1788875262.292435:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x60858e6020d834e0 00000004:00100000:0.0:1788875262.292451:0:14490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788875262.292493:0:14490:0:(import.c:65:import_set_state_nolock()) ffff9e5906e7d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788875262.292562:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875771241105792:12345-0@lo:38:llog_process_th.0 Request processed in 204us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.292570:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788875262.292821:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a3cd88700 x1875771241105792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788875272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875262.292832:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788875262.292840:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788875262.292846:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788875262.292851:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788875262.292853:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e59065c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788875262.292858:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875771241105792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788875262.293066:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241105920:0@lo:400:kworker.0 00000100:00100000:2.0:1788875262.293112:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788875262.293368:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788875262.293664:0:15891:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788875262.293689:0:15891:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788875262.293705:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834cb expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.293715:0:15891:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44c00/0x60858e6020d834c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834cb expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788875262.293785:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788875262.293792:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788875262.293793:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875262.293794:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875262.293796:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875262.293797:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875262.293798:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788875262.293800:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875262.293801:0:15891:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788875262.293804:0:15891:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788875262.293807:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788875262.293808:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788875262.293809:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875262.293810:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875262.293811:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875262.293812:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875262.293813:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788875262.293814:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875262.293815:0:15891:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788875262.293829:0:15891:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788875262.293840:0:15891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241106048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788875262.293883:0:15891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.293915:0:15891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585ac00 going to sleep for 11 seconds 00000100:00080000:0.0:1788875262.294077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788875262.294083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788875262.294086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788875262.294090:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1788875262.294094:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788875262.294098:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:0.0:1788875262.294118:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a36288000 x1875771241106176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788875262.294175:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241106304:0@lo:400:kworker.0 00000100:00100000:0.0:1788875262.294206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.294232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788875262.294237:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241106432:0@lo:400:kworker.0 00000100:00100000:0.0:1788875262.294259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875262.294294:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106304 00000100:00100000:0.0:1788875262.294300:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106304 00000100:00100000:0.0:1788875262.294332:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106432 00000100:00100000:0.0:1788875262.294335:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106432 00000100:00100000:0.0:1788875262.294350:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788875262.294357:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875262.294409:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875771241106304:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.294416:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788875262.294430:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788875262.294436:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241106432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875262.294462:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241106432:12345-0@lo:400:kworker.0 Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.294467:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788875262.294510:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a36288380 x1875771241106432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875262.294637:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241106432:0@lo:400:kworker.0 00010000:00080000:0.0:1788875262.294652:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5a3628a680 x1875771241106304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788875262.294661:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875771241106304:0@lo:400:kworker.0 00000100:00100000:1.0:1788875262.294872:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106048 00000100:00100000:1.0:1788875262.294877:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106048 00000100:00100000:1.0:1788875262.294909:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788875262.294917:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:15891:x1875771241106048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788875262.294937:0:14483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788875262.294951:0:14483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788875262.296844:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241105920 00000100:00100000:0.0:1788875262.296858:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241105920 00000100:00100000:0.0:1788875262.296910:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788875262.296919:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241105920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875262.299216:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241105920:12345-0@lo:400:kworker.0 Request processed in 2291us (6096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.299230:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788875262.299543:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241106176:0@lo:8:kworker.0 00000100:00100000:0.0:1788875262.299618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875262.301094:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106176 00000100:00100000:1.0:1788875262.301107:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106176 00000100:00100000:1.0:1788875262.301145:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788875262.301153:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241106176:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788875262.301240:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241106176:12345-0@lo:8:kworker.0 Request processed in 86us (1621us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788875262.301247:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788875262.301302:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788875262.301311:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788875262.301315:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788875262.301319:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241106176:0@lo:8:kworker.0 00000100:00100000:2.0:1788875262.312933:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241105920:0@lo:400:kworker.0 20000000:01000000:0.0:1788875262.350686:0:14483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788875262.350728:0:14483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788875262.350820:0:14504:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788875262.350826:0:14504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788875262.350848:0:14504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.350868:0:14504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d833ba expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.350877:0:14504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.350920:0:14504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.350944:0:14504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 19 pid: 14481 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875262.350968:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241106560:0@lo:104: 00000100:00100000:3.0:1788875262.351037:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.351077:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875262.354393:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106560 00000100:00100000:0.0:1788875262.354408:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106560 00000100:00100000:0.0:1788875262.354458:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788875262.354468:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241106560:12345-0@lo:104: 00010000:00010000:0.0:1788875262.354497:0:14472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354606:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788875262.354613:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:14504:x1875771241106560:12345-0@lo:104: Request processed in 147us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.354620:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788875262.354642:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875262.354648:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354656:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:0.0:1788875262.354660:0:14476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354667:0:14476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788875262.354675:0:14476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788875262.354680:0:14476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788875262.354717:0:14476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354724:0:14476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788875262.354762:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354769:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d833ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d833c1 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875262.354817:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875262.354819:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875262.354821:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875262.354838:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241106688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875262.354876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875262.355006:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14504:1875771241106560:0@lo:104: 00010000:00010000:3.0:1788875262.355030:0:14504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875262.355056:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106688 00000100:00100000:3.0:1788875262.355061:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106688 00010000:00010000:3.0:1788875262.355080:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 20 pid: 14481 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875262.355111:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875262.355117:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+20:3303:x1875771241106688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875262.355129:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875262.355135:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 20 pid: 14481 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355145:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 20 pid: 14481 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355159:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d833c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d833ba expref: 20 pid: 14481 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355172:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355188:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788875262.355202:0:14473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005531594s 00010000:00010000:3.0:1788875262.355207:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355214:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355222:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355228:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355233:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875262.355238:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355246:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355259:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355268:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875262.355310:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+19:3303:x1875771241106688:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875262.355318:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788875262.355355:0:14504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355363:0:14504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875262.355370:0:14504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15400/0x60858e6020d834e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875262.355396:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241106688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875262.367207:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+18:15891:x1875771241106048:12345-0@lo:253:mount.lustre.0 Request processed in 72279us (73312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875262.367223:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788875262.367311:0:15891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23009a34-c6dd-4af5-b962-084fb475da02:15891:1875771241106048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788875262.367328:0:15891:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788875262.367331:0:15891:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788875262.367334:0:15891:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788875262.367335:0:15891:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788875262.367336:0:15891:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788875262.367337:0:15891:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788875262.367338:0:15891:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788875262.367340:0:15891:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788875262.367342:0:15891:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788875262.367343:0:15891:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788875262.367361:0:15891:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788875262.373695:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875262.374129:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788875262.374317:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875262.374454:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788875262.374893:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788875262.377415:0:15891:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788875262.378491:0:15891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788875262.434330:0:15891:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788875262.434338:0:15891:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788875262.434381:0:15891:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788875262.434435:0:15891:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788875262.434449:0:15891:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788875262.434479:0:15891:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788875262.606671:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788875263.118397:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788875263.569069:0:14485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788875263.569077:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e59064ff800 from 8 10000000:01000000:2.0:1788875263.569094:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788875263.569144:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569157:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569170:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875263.569196:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241106816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788875263.569263:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875263.569322:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875263.569346:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106816 00000100:00100000:2.0:1788875263.569354:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106816 00000100:00100000:2.0:1788875263.569404:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788875263.569412:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241106816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875263.569426:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875263.569441:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35c45e00/0x60858e6020d834f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d834ee expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569466:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35c45e00/0x60858e6020d834f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d834ee expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569477:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35c45e00/0x60858e6020d834f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d834ee expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569494:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c45e00, rc 0) 00000100:00100000:2.0:1788875263.569534:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241106816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875263.569542:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788875263.569592:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241106816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875263.569606:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834f5 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.569616:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d834f5 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875263.569661:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241106944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788875263.569690:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875263.569704:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813780 going to sleep for 11 seconds 00000100:00100000:2.0:1788875263.569717:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241106944 00000100:00100000:2.0:1788875263.569720:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241106944 00000100:00100000:2.0:1788875263.569739:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788875263.569745:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241106944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788875263.569758:0:14483:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788875263.569794:0:14483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788875263.569798:0:14483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788875263.569864:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241106944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875263.569872:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788875263.569898:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241106944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788875263.570124:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788875263.570131:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834f5 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875263.570140:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44e00/0x60858e6020d834ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d834f5 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875263.637524:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875264.654539:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875265.678229:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875266.708273:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875266.896098:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241107072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788875266.896198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875266.896413:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107072 00000100:00100000:0.0:1788875266.896423:0:15175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107072 00000100:00100000:0.0:1788875266.896488:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788875266.896500:0:15175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241107072:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788875266.897100:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788875266.897210:0:15175:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875266.897282:0:15175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241107072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 784us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875266.897291:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788875266.897514:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241107072:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788875267.406302:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788875267.406312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788875267.406316:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788875267.406330:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5a0495f800 using connection 192.168.202.107@tcp/0@lo 00000100:00100000:2.0:1788875267.406354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5a3fd48000 x1875771241107456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788875267.406450:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241107200:0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.406527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.406582:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241107840:0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.406626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.406655:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788875267.406661:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241107328:0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.406687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.406719:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241107584:0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.407130:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875267.407136:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241107712:0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407259:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.407295:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107200 00000100:00100000:2.0:1788875267.407302:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107200 00000100:00100000:2.0:1788875267.407342:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788875267.407350:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241107200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407392:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241107200:12345-0@lo:400:kworker.0 Request processed in 43us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.407400:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788875267.407431:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107840 00000100:00100000:2.0:1788875267.407434:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107840 00000100:00100000:2.0:1788875267.407469:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107584 00000100:00100000:2.0:1788875267.407473:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107584 00000100:00100000:2.0:1788875267.407485:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107712 00000100:00100000:2.0:1788875267.407487:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107712 00000100:00100000:2.0:1788875267.407502:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788875267.407508:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241107840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407542:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241107840:12345-0@lo:400:kworker.0 Request processed in 34us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.407549:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788875267.407560:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788875267.407565:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241107584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407608:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241107584:12345-0@lo:400:kworker.0 Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.407614:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788875267.407626:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788875267.407631:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241107712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.407657:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241107712:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.407670:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788875267.407694:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107328 00000100:00100000:2.0:1788875267.407698:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107328 00000100:00100000:2.0:1788875267.407725:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788875267.407730:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241107328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875267.409514:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241107328:12345-0@lo:400:kworker.0 Request processed in 1772us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.409531:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788875267.410271:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875267.410982:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241107456:0@lo:8:kworker.0 00000100:00100000:1.0:1788875267.411134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875267.411704:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107456 00000100:00100000:1.0:1788875267.411723:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107456 00000100:00100000:1.0:1788875267.412099:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788875267.412108:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875771241107456:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788875267.412149:0:15170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1788875267.412909:0:15170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x60858e6020d834fc 00010000:00080000:2.0:1788875267.413036:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3fd4a680 x1875771241107712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875267.413051:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241107712:0@lo:400:kworker.0 00010000:00080000:2.0:1788875267.413066:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3fd4a300 x1875771241107584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788875267.413074:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241107584:0@lo:400:kworker.0 00002000:00100000:1.0:1788875267.413254:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e5904cce000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788875267.413258:0:15170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788875267.413261:0:15170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788875267.413616:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788875267.413647:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e5904ccd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788875267.413730:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875771241107456:12345-0@lo:8:kworker.0 Request processed in 1621us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.414968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241107328:0@lo:400:kworker.0 00000100:00100000:1.0:1788875267.415496:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788875267.416266:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3fd48000 x1875771241107456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788875292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788875267.416287:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788875267.416295:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788875267.416301:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788875267.416305:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e5a0495f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788875267.416319:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788875267.416324:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875771241107456:0@lo:8:kworker.0 00000004:00080000:2.0:1788875267.416644:0:14512:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788875267.417056:0:14513:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788875267.417078:0:14513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14513:1875771241108096:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788875267.417137:0:14513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875267.417253:0:14513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a08415a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788875267.418311:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241107200:0@lo:400:kworker.0 00010000:00080000:3.0:1788875267.418337:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3fd4aa00 x1875771241107840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788875283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875267.418348:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241107840:0@lo:400:kworker.0 00000100:00100000:3.0:1788875267.418372:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875267.418380:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241107968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875267.418419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875267.418463:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241107968 00000100:00100000:3.0:1788875267.418469:0:15175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241107968 00000100:00100000:3.0:1788875267.418521:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875267.418530:0:15175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241107968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875267.418562:0:15175:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875267.418685:0:15175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241107968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875267.418693:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788875267.418730:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788875267.419065:0:14512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 482284291499ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788875267.419148:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108096 00000100:00100000:2.0:1788875267.419153:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108096 00010000:00080000:3.0:1788875267.419268:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5a3cd89500 x1875771241107968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788875283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788875267.419285:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241107968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875267.420305:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788875267.420319:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14513:x1875771241108096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788875267.434399:0:15172:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788875267.434413:0:15172:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788875267.434419:0:15172:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788875267.443728:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.443856:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.443875:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.443880:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.443886:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.443905:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.444013:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.444033:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.444056:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875267.444114:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875267.444122:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.444131:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c44800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875267.444143:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.444153:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.444171:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.444178:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601afe38/0x60858e6020d83503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.444196:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.444198:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.444199:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.445011:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.445320:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.445333:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.445336:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.445342:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.445366:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.445375:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.445382:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.445409:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875267.445612:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875267.445618:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.445626:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875267.445631:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.445640:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.445653:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.445666:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d8350a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.445683:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.445685:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.445687:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.446102:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.446109:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446120:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.446123:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.446127:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446136:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446145:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446243:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446264:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875267.446352:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875267.446357:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.446376:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c44600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875267.446380:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.446389:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.446402:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.446409:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319224b3/0x60858e6020d83511 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.446424:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.446426:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.446428:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.446688:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.446693:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446702:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.446705:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.446709:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446717:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446725:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.446732:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.448100:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875267.448249:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.448257:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.448270:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.448286:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.448297:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.448315:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.448323:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d083f584/0x60858e6020d83518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.448344:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.448345:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.448347:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.450322:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.450335:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.450358:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.450363:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.450370:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.450385:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.450395:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.450404:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.450430:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788875267.450500:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788875267.450507:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.450516:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875267.450520:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.450529:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.450544:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.450551:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a327a34b/0x60858e6020d8351f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875267.450570:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.450572:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788875267.450574:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.452381:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.452395:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.452410:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.452414:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.452420:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.452432:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.452451:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.452459:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.452484:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875267.454182:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.454194:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.454207:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.454212:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.454223:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.454257:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.454274:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e65abafc/0x60858e6020d83526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.454299:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.454301:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.454303:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.455110:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.455120:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.455132:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.455136:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.455142:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.455154:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.455616:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.455624:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.455692:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.456293:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.456299:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.456310:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.456313:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.456318:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.456328:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.456337:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.456344:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456763:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.456781:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456790:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.456794:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456803:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456924:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456933:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd02b249/0x60858e6020d8352d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456952:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.456955:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456968:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.456972:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456980:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456990:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.456998:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.456999:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.457001:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.459761:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.459786:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d83534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.461249:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.461259:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.461280:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.461285:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.461292:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.461309:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.461320:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.461329:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.461531:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.461539:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.461547:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.461553:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.461562:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.461577:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.461592:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.461594:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.461596:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.462252:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.462259:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d8353b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.462863:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.462871:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.462883:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.462887:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.462892:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.462928:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.462939:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.462945:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.463263:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.463269:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.463277:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.463281:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.463289:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.463304:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.463320:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.463322:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.463324:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.463540:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.463546:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d83542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.465405:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.465566:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.465573:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.465587:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.465591:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.465598:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.465610:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.465632:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.465640:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.465696:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.466364:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.466371:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466381:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.466384:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.466389:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466398:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466406:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466414:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466623:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.466630:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466638:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.466649:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466658:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466676:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466682:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d83549 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466699:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.466702:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466709:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.466712:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466719:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.466728:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466887:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.466892:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.466911:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.467096:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.467103:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.467105:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.469525:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.469536:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469551:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.469555:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.469561:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469575:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469585:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469592:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469608:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875267.469620:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875267.469632:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469640:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875267.469645:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469655:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469670:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469678:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d83557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.469693:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.469695:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.469697:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.484494:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.484510:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.484528:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.484533:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.484539:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.484565:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.484578:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.484587:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.485307:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.486325:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.486335:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.486348:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.486351:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.486356:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.486369:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.486379:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.486399:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.486727:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.486736:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.486898:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.486904:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.486969:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.486988:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.486997:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d8355e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.487083:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.487088:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.487096:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.487099:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.487120:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.487132:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.487140:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.487142:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.487144:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.487325:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.487331:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022142a0a/0x60858e6020d83565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875267.487826:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788875267.491262:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788875267.491809:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.492453:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.492474:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.492480:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.492487:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.492504:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.492516:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.492525:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.492597:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.493181:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.493188:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.493199:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.493203:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.493208:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.493220:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.493228:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.493270:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788875267.493370:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788875267.493719:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.493727:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493798:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.493803:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493869:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493888:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493895:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb18d78f/0x60858e6020d8356c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493983:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.493987:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.493995:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.493998:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.494006:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.494080:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.494092:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.494093:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.494095:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.494378:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.494384:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c17e1d/0x60858e6020d83573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875267.495055:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.495467:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.495474:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.495491:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.495496:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.495502:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.495516:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.495526:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.495535:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.496027:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.496649:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.496656:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.496668:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.496672:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.496677:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.496687:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.496707:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.496714:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498850:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.498865:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498878:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.498883:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498911:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498933:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498942:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280377ad/0x60858e6020d8357a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498967:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.498971:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498976:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.498979:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498986:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.498996:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.499003:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.499005:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.499013:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.500137:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.500147:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000462af403/0x60858e6020d83581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.500431:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.501662:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.501672:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.501688:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.501693:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.501699:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.501713:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.501723:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.501755:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.502172:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.502606:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.502612:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.502621:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.502624:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.502629:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.502638:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.502646:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.502653:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503000:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.503008:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503026:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.503031:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503040:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503055:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503063:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e373f2f/0x60858e6020d83588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503080:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.503083:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503090:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.503093:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503113:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503123:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.503131:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.503133:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.503135:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.503324:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.503330:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfcc1c2e/0x60858e6020d8358f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.503814:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.503829:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.503838:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.503841:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.503845:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.503855:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.503863:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.503870:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.504251:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.504258:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.504266:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.504271:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.504279:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.504292:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.504302:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.504304:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.504306:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.504378:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.504383:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a739d70/0x60858e6020d83596 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.505015:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.505034:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.505054:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.505057:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.505061:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.505072:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.505081:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.505089:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.505299:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.505306:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.505313:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.505317:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.505325:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.505337:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.505347:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.505348:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.505350:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.505415:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.505421:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa2d5669/0x60858e6020d8359d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.509485:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.509500:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.509519:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.509523:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.509530:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.509556:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.509567:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.509576:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.510864:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.510874:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.510886:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.510891:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.510901:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.510942:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.510953:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.510955:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.510957:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.511987:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.511998:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001583ea95/0x60858e6020d835a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.512364:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.513680:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.513689:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.513705:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.513709:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.513716:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.513730:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.515127:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.515136:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.515241:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788875267.516142:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.516151:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.516851:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.516858:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.516872:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.516897:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.516904:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065fa4387/0x60858e6020d835ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.517125:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.517128:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.517139:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788875267.522136:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.522152:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.522252:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.522257:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.522264:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.522282:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.522294:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.522303:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.522397:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788875267.525392:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.525408:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.525427:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.525432:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.525438:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.525454:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.525466:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.525474:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526428:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788875267.526437:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526446:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.526449:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526456:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526470:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526475:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d835b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526496:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.526498:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526502:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.526504:0:14476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526508:0:14476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526521:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.526525:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.526527:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.526528:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.526620:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.526624:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d835b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788875267.527446:0:15172:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788875267.527452:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.527464:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788875267.527467:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875267.527471:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.527479:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.527485:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875267.527490:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.527730:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875267.527735:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.527741:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:1.0:1788875267.527744:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.527801:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.527813:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875267.527819:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.527821:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875267.527822:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875267.527893:0:15172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788875267.527899:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d835c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788875267.528075:0:15172:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788875267.528288:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14513:x1875771241108096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 107842us (111019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875267.528298:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788875267.528358:0:14513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd88e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14513:1875771241108096:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788875267.528375:0:14513:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788875267.528424:0:14513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14513:1875771241108224:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788875267.528470:0:14513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875267.528511:0:14513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3c695540 going to sleep for 11 seconds 00000100:00100000:2.0:1788875267.528527:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108224 00000100:00100000:2.0:1788875267.528533:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108224 00000100:00100000:2.0:1788875267.528575:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788875267.528583:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14513:x1875771241108224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788875267.528620:0:15172:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788875267.533083:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875267.539963:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14513:x1875771241108224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11371us (11483us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788875267.539988:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788875267.540202:0:14513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14513:1875771241108224:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788875267.540216:0:14513:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788875267.728498:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788875268.502768:0:16245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg207-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788875268.752698:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875269.774708:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875270.798467:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875270.822275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875270.822444:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043648 00000100:00100000:2.0:1788875270.822456:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043648 00000100:00100000:2.0:1788875270.822516:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:2.0:1788875270.822525:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875771218043648:12345-192.168.202.7@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788875270.822559:0:14481:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 287afd9b-867a-48fc-8e7f-a9e11341315a@192.168.202.7@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788875270.822589:0:14481:0:(genops.c:1385:class_connect()) connect: client 287afd9b-867a-48fc-8e7f-a9e11341315a, cookie 0x60858e6020d835c7 00000100:00080000:2.0:1788875270.822718:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9e59065c0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875270.822952:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+5:2346:x1875771218043648:12345-192.168.202.7@tcp:250:mount.lustre.0 Request processed in 425us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875270.822961:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 77 00000100:00100000:2.0:1788875270.843015:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.843463:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043776 00000100:00100000:0.0:1788875270.843477:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043776 00000100:00100000:0.0:1788875270.843541:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:0.0:1788875270.843552:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3f761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+5:13772:x1875771218043776:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788875270.843570:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875270.843591:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1800/0x60858e6020d835ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0eee expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.843644:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1800/0x60858e6020d835ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eee expref: 6 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.843656:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee1800/0x60858e6020d835ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0eee expref: 6 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.843667:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1800, rc 0) 00000100:00100000:0.0:1788875270.843741:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3f761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+6:13772:x1875771218043776:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 190us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.843748:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 78 00000100:00100000:1.0:1788875270.860539:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.860680:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218043904 00000100:00100000:0.0:1788875270.860690:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218043904 00000100:00100000:0.0:1788875270.860902:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:0.0:1788875270.860914:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+6:13772:x1875771218043904:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788875270.861215:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+6:13772:x1875771218043904:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 303us (686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788875270.861223:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 79 00000100:00100000:3.0:1788875270.868869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875270.870357:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044032 00000100:00100000:2.0:1788875270.870372:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044032 00000100:00100000:2.0:1788875270.870449:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:2.0:1788875270.870461:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+6:13772:x1875771218044032:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788875270.870498:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875270.870519:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5907848000/0x60858e6020d835d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ef5 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875270.870552:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5907848000/0x60858e6020d835d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ef5 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875270.870565:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5907848000/0x60858e6020d835d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ef5 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875270.870573:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848000, rc 0) 00000100:00100000:2.0:1788875270.870644:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+7:13772:x1875771218044032:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 185us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875270.870652:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 80 00000100:00100000:1.0:1788875270.878391:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.881425:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044160 00000100:00100000:0.0:1788875270.881442:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044160 00000100:00100000:0.0:1788875270.881512:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:0.0:1788875270.881524:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+7:13772:x1875771218044160:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788875270.881809:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13772:x1875771218044160:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 287us (3429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.881818:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 81 00000100:00100000:1.0:1788875270.896304:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.896608:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044288 00000100:00100000:0.0:1788875270.896634:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044288 00000100:00100000:0.0:1788875270.896703:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:0.0:1788875270.896714:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13772:x1875771218044288:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788875270.897014:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13772:x1875771218044288:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 301us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.897024:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 82 00000100:00100000:3.0:1788875270.905836:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.907667:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044416 00000100:00100000:0.0:1788875270.907683:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044416 00000100:00100000:0.0:1788875270.907759:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:0.0:1788875270.907790:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13790:x1875771218044416:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788875270.908539:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13790:x1875771218044416:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 769us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.908551:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 83 00000100:00100000:1.0:1788875270.949597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875270.950008:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044544 00000100:00100000:2.0:1788875270.950018:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044544 00000100:00100000:2.0:1788875270.950078:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:2.0:1788875270.950089:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13790:x1875771218044544:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875270.951562:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13790:x1875771218044544:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 1466us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875270.951575:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 84 00000100:00100000:1.0:1788875270.958524:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.958701:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044672 00000100:00100000:0.0:1788875270.958711:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044672 00000100:00100000:0.0:1788875270.958810:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:0.0:1788875270.958823:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+8:13772:x1875771218044672:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788875270.958844:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875270.958864:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1600/0x60858e6020d835dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f1f expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.958899:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1600/0x60858e6020d835dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f1f expref: 9 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.958912:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee1600/0x60858e6020d835dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f1f expref: 9 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.958939:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1600, rc 0) 00000100:00100000:0.0:1788875270.959183:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+9:13772:x1875771218044672:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 362us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.959191:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 85 00000100:00100000:3.0:1788875270.966374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875270.967019:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044800 00000100:00100000:2.0:1788875270.967033:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044800 00000100:00100000:2.0:1788875270.967097:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:2.0:1788875270.967108:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+9:13772:x1875771218044800:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788875270.967143:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788875270.967175:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788875270.967180:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788875270.967183:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788875270.967186:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788875270.970398:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+9:13772:x1875771218044800:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 3280us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875270.970413:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 86 00000100:00100000:1.0:1788875270.979537:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875270.979655:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218044928 00000100:00100000:0.0:1788875270.979666:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218044928 00000100:00100000:0.0:1788875270.979725:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:0.0:1788875270.979737:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+9:13772:x1875771218044928:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788875270.979755:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875270.979814:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f26 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.979863:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 10 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.979876:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 10 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875270.980174:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0a00, rc 0) 00000100:00100000:0.0:1788875270.980257:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13772:x1875771218044928:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 522us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875270.980264:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 87 00000100:00100000:3.0:1788875270.983291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875270.985064:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045056 00000100:00100000:2.0:1788875270.985080:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045056 00000100:00100000:2.0:1788875270.985154:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:2.0:1788875270.985166:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13772:x1875771218045056:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788875270.985519:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13772:x1875771218045056:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 354us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875270.985528:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 88 00000100:00100000:1.0:1788875271.004106:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875271.004318:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045184 00000100:00100000:0.0:1788875271.004329:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045184 00000100:00100000:0.0:1788875271.004387:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:0.0:1788875271.004397:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13772:x1875771218045184:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788875271.004684:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13772:x1875771218045184:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 287us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875271.004692:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 89 00000100:00100000:1.0:1788875271.008598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875271.008699:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045312 00000100:00100000:3.0:1788875271.008711:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045312 00000100:00100000:3.0:1788875271.008805:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:3.0:1788875271.008815:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13794:x1875771218045312:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788875271.009129:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13794:x1875771218045312:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 315us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875271.009138:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 90 00000100:00100000:3.0:1788875271.015139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.015282:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045440 00000100:00100000:2.0:1788875271.015292:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045440 00000100:00100000:2.0:1788875271.015356:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:2.0:1788875271.015366:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13794:x1875771218045440:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875271.015621:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13794:x1875771218045440:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 255us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875271.015629:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 91 00000100:00100000:1.0:1788875271.024592:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.024698:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045568 00000100:00100000:2.0:1788875271.024709:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045568 00000100:00100000:2.0:1788875271.024763:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:2.0:1788875271.024808:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875771218045568:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788875271.024839:0:14490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5c03ea99-fe93-4040-b0ab-19354d12a812@192.168.202.7@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788875271.024919:0:14490:0:(genops.c:1385:class_connect()) connect: client 5c03ea99-fe93-4040-b0ab-19354d12a812, cookie 0x60858e6020d835ea 00000004:00100000:2.0:1788875271.024950:0:14490:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788875271.024956:0:14490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788875271.120025:0:14490:0:(import.c:65:import_set_state_nolock()) ffff9e5906e7f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788875271.120132:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2346:x1875771218045568:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 95359us (95549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875271.120145:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1788875271.126510:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.126605:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045696 00000100:00100000:2.0:1788875271.126615:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045696 00000100:00100000:2.0:1788875271.126686:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1788875271.126696:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:0:x1875771218045696:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875271.126735:0:14489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788875271.126904:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875271.126932:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875271.126985:0:14490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875271.126994:0:14490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788875271.127076:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:0:x1875771218045696:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 381us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875271.127084:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:2.0:1788875271.127099:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045824 00000100:00100000:2.0:1788875271.127102:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045824 00000100:00100000:2.0:1788875271.127123:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:2.0:1788875271.127129:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218045824:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875271.127139:0:14489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875271.127159:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218045824:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875271.127165:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1788875271.129294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.129437:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218045952 00000100:00100000:2.0:1788875271.129446:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218045952 00000100:00100000:2.0:1788875271.129501:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1788875271.129510:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218045952:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788875271.129597:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218045952:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875271.129616:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875271.135917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.137023:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046080 00000100:00100000:2.0:1788875271.137039:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046080 00000100:00100000:2.0:1788875271.137105:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1788875271.137116:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875771218046080:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788875271.137152:0:15170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5c03ea99-fe93-4040-b0ab-19354d12a812@192.168.202.7@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:2.0:1788875271.137218:0:15170:0:(genops.c:1385:class_connect()) connect: client 5c03ea99-fe93-4040-b0ab-19354d12a812, cookie 0x60858e6020d835f1 00002000:00100000:2.0:1788875271.137231:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c03ea99-fe93-4040-b0ab-19354d12a812/ffff9e5a3cd13000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788875271.137255:0:15170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788875271.137953:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788875271.137993:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e5904d3f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788875271.138134:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2346:x1875771218046080:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 1016us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875271.138142:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1788875271.147465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875271.147514:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875271.147605:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046208 00000100:00100000:2.0:1788875271.147615:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046208 00000100:00100000:2.0:1788875271.147662:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875271.147671:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875771218046208:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788875271.147707:0:15172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5c03ea99-fe93-4040-b0ab-19354d12a812@192.168.202.7@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:2.0:1788875271.147742:0:15172:0:(genops.c:1385:class_connect()) connect: client 5c03ea99-fe93-4040-b0ab-19354d12a812, cookie 0x60858e6020d835f8 00002000:00100000:2.0:1788875271.147753:0:15172:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c03ea99-fe93-4040-b0ab-19354d12a812/ffff9e5a3cd14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788875271.147798:0:15172:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788875271.148012:0:15172:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788875271.148042:0:15172:0:(import.c:65:import_set_state_nolock()) ffff9e5a3cd15000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875271.148109:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2346:x1875771218046208:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 437us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875271.148117:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1788875271.148631:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046336 00000100:00100000:0.0:1788875271.148638:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046336 00000100:00100000:0.0:1788875271.148681:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:0.0:1788875271.148690:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218046336:12345-192.168.202.7@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788875271.152484:0:14491:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3736us 00000004:00200000:1.0:1788875271.176934:0:14491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788875271.177077:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13772:x1875771218046336:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 28382us (29556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875271.177092:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1788875271.354467:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875271.355146:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046464 00000100:00100000:0.0:1788875271.355157:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046464 00000100:00100000:0.0:1788875271.355280:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:0.0:1788875271.355291:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13815:x1875771218046464:12345-192.168.202.7@tcp:101:mkdir.0 00010000:00010000:0.0:1788875271.355313:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875271.355340:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d835ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f50 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355412:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355426:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355454:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875271.355489:0:14490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875271.355493:0:14490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875271.355655:0:14490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355683:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0e00/0x60858e6020d835ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f50 expref: 8 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355700:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f50 expref: 7 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875271.355709:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875271.355713:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875271.355716:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1a00, rc 0) 00000100:00100000:0.0:1788875271.355886:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+7:13815:x1875771218046464:12345-192.168.202.7@tcp:101:mkdir.0 Request processed in 588us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875271.355893:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00010000:00010000:1.0:1788875271.822062:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875272.014529:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875272.014563:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241108352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875272.014664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875272.014805:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108352 00000100:00100000:2.0:1788875272.014817:0:15175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108352 00000100:00100000:2.0:1788875272.014955:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788875272.014966:0:15175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241108352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788875272.014991:0:15175:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788875272.015045:0:15175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875771241108352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875272.015052:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788875272.015289:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875272.015349:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241108352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875272.533950:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241108480:0@lo:400:kworker.0 00000100:00100000:1.0:1788875272.534028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875272.534207:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788875272.534242:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875272.534275:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875272.534282:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241108736:0@lo:400:kworker.0 00000100:00100000:3.0:1788875272.534303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875272.534347:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108608 00000100:00100000:3.0:1788875272.534357:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108608 00000100:00100000:3.0:1788875272.534412:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108736 00000100:00100000:3.0:1788875272.534416:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108736 00000100:00100000:3.0:1788875272.534462:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875272.534472:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241108608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875272.534526:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241108608:12345-0@lo:400:kworker.0 Request processed in 56us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875272.534534:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788875272.534570:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788875272.534576:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241108736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875272.534604:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875771241108736:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875272.534610:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788875272.534656:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241108736:0@lo:400:kworker.0 00000100:00100000:3.0:1788875272.534667:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241108608:0@lo:400:kworker.0 00000100:00100000:1.0:1788875272.540147:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241108992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788875272.540244:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875272.540292:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788875272.540299:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241108864:0@lo:400:kworker.0 00000100:00100000:1.0:1788875272.540342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875272.544673:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108992 00000100:00100000:1.0:1788875272.544688:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108992 00000100:00080000:0.0:1788875272.545009:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875272.545028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241109120:0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545110:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875272.545147:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788875272.545153:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241109248:0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875272.545228:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108864 00000100:00100000:0.0:1788875272.545233:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108864 00000100:00100000:0.0:1788875272.545273:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109120 00000100:00100000:0.0:1788875272.545276:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109120 00000100:00100000:0.0:1788875272.545293:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109248 00000100:00100000:0.0:1788875272.545296:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109248 00000100:00100000:0.0:1788875272.545312:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788875272.545320:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545369:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241108864:12345-0@lo:400:kworker.0 Request processed in 50us (5025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875272.545376:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788875272.545408:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788875272.545416:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545448:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241109120:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875272.545454:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788875272.545467:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788875272.545473:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545510:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241109248:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875272.545516:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788875272.545538:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875272.545566:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241109248:0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545578:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241109120:0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545624:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545707:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788875272.545716:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241108992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875272.545732:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875272.545796:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241108992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875272.545812:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788875272.545850:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241108992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875272.545905:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241108480 00000100:00100000:0.0:1788875272.545910:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241108480 00000100:00100000:0.0:1788875272.545935:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788875272.545942:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3df27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:3304:x1875771241108480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875272.545980:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3df27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:3304:x1875771241108480:12345-0@lo:400:kworker.0 Request processed in 39us (11953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875272.545986:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788875272.546016:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241108480:0@lo:400:kworker.0 00000001:00100000:3.0:1788875272.641205:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c03ea99-fe93-4040-b0ab-19354d12a812 00000001:00080000:3.0:1788875272.641278:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1788875272.846166:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788875273.359629:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788875273.546937:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.547122:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046592 00000100:00100000:0.0:1788875273.547134:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046592 00000100:00100000:0.0:1788875273.547259:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1788875273.547273:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:13868:x1875771218046592:12345-192.168.202.7@tcp:41:lfs.0 00000004:00000024:0.0:1788875273.547321:0:14488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788875273.547421:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:13868:x1875771218046592:12345-192.168.202.7@tcp:41:lfs.0 Request processed in 152us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.547437:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:2.0:1788875273.547873:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875273.550971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.551305:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046720 00000100:00100000:0.0:1788875273.551316:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046720 00000100:00100000:0.0:1788875273.551428:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:0.0:1788875273.551441:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13868:x1875771218046720:12345-192.168.202.7@tcp:13:lfs.0 00002000:00000024:0.0:1788875273.551492:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875273.551586:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c03ea99-fe93-4040-b0ab-19354d12a812+6:13868:x1875771218046720:12345-192.168.202.7@tcp:13:lfs.0 Request processed in 148us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.551594:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00080000:2.0:1788875273.552132:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788875273.559029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.559180:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046848 00000100:00100000:0.0:1788875273.559192:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046848 00000100:00100000:0.0:1788875273.559278:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:0.0:1788875273.559292:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c03ea99-fe93-4040-b0ab-19354d12a812+5:13868:x1875771218046848:12345-192.168.202.7@tcp:13:lfs.0 00002000:00000024:0.0:1788875273.559341:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875273.559702:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c03ea99-fe93-4040-b0ab-19354d12a812+5:13868:x1875771218046848:12345-192.168.202.7@tcp:13:lfs.0 Request processed in 413us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.559710:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00080000:2.0:1788875273.560154:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875273.772048:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.772198:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218046976 00000100:00100000:0.0:1788875273.772215:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218046976 00000100:00100000:0.0:1788875273.772311:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:0.0:1788875273.772324:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+10:13901:x1875771218046976:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788875273.772341:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875273.772359:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d8360d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f57 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875273.772390:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d8360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f57 expref: 11 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875273.772403:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0e00/0x60858e6020d8360d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f57 expref: 11 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875273.772433:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0e00, rc 0) 00000100:00100000:0.0:1788875273.772515:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218046976:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 193us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.772523:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 93 00000100:00100000:1.0:1788875273.785948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.786275:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047104 00000100:00100000:0.0:1788875273.786286:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047104 00000100:00100000:0.0:1788875273.786350:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:0.0:1788875273.786360:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218047104:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788875273.786666:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218047104:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 305us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.786674:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 94 00000100:00100000:1.0:1788875273.792602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.792708:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047232 00000100:00100000:2.0:1788875273.792718:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047232 00000100:00100000:2.0:1788875273.792807:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:2.0:1788875273.792819:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218047232:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788875273.793134:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218047232:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 317us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.793140:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 95 00000100:00100000:3.0:1788875273.799101:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.799576:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047360 00000100:00100000:2.0:1788875273.799591:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047360 00000100:00100000:2.0:1788875273.799664:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:2.0:1788875273.799677:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13907:x1875771218047360:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875273.801349:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13907:x1875771218047360:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 1661us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.801362:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 96 00000100:00100000:1.0:1788875273.822761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.822917:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047488 00000100:00100000:0.0:1788875273.822928:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047488 00000100:00100000:0.0:1788875273.823090:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:0.0:1788875273.823102:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13907:x1875771218047488:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788875273.823422:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13907:x1875771218047488:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 321us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.823431:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 97 00000100:00100000:1.0:1788875273.832331:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.832676:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047616 00000100:00100000:2.0:1788875273.832688:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047616 00000100:00100000:2.0:1788875273.832840:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:2.0:1788875273.832854:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13901:x1875771218047616:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788875273.832873:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875273.832893:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5907849600/0x60858e6020d83614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f81 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875273.832925:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5907849600/0x60858e6020d83614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f81 expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875273.832940:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5907849600/0x60858e6020d83614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f81 expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875273.832952:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907849600, rc 0) 00000100:00100000:2.0:1788875273.833027:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13901:x1875771218047616:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 177us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.833035:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 98 00000100:00100000:1.0:1788875273.841310:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.841582:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047744 00000100:00100000:2.0:1788875273.841593:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047744 00000100:00100000:2.0:1788875273.841661:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:2.0:1788875273.841672:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13901:x1875771218047744:12345-192.168.202.7@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788875273.841697:0:14482:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788875273.841721:0:14482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788875273.841725:0:14482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788875273.841729:0:14482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788875273.841731:0:14482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788875273.849461:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13901:x1875771218047744:12345-192.168.202.7@tcp:256:mount.lustre.0 Request processed in 7776us (8150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.849731:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 99 00000100:00100000:1.0:1788875273.853449:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875273.853580:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218047872 00000100:00100000:3.0:1788875273.853590:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218047872 00000100:00100000:3.0:1788875273.853641:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:3.0:1788875273.853650:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13901:x1875771218047872:12345-192.168.202.7@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788875273.853664:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875273.853689:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0f88 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875273.853718:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 13 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875273.853742:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 13 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875273.853752:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14600, rc 0) 00000100:00100000:3.0:1788875273.853832:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13901:x1875771218047872:12345-192.168.202.7@tcp:101:mount.lustre.0 Request processed in 183us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875273.853839:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 100 00000100:00100000:1.0:1788875273.860310:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.860552:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048000 00000100:00100000:2.0:1788875273.860562:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048000 00000100:00100000:2.0:1788875273.860656:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:2.0:1788875273.860667:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13901:x1875771218048000:12345-192.168.202.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788875273.861037:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13901:x1875771218048000:12345-192.168.202.7@tcp:501:mount.lustre.0 Request processed in 370us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.861047:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 101 00000100:00100000:1.0:1788875273.865211:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.865332:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048128 00000100:00100000:0.0:1788875273.865345:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048128 00000100:00100000:0.0:1788875273.865415:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 102 00000100:00100000:0.0:1788875273.865426:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a37232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13901:x1875771218048128:12345-192.168.202.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788875273.865751:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a37232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13901:x1875771218048128:12345-192.168.202.7@tcp:503:mount.lustre.0 Request processed in 326us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.865769:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 102 00010000:00010000:3.0:1788875273.873285:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875273.877844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.880041:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048256 00000100:00100000:2.0:1788875273.880059:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048256 00000100:00100000:2.0:1788875273.880132:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:2.0:1788875273.880142:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13910:x1875771218048256:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788875273.880453:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13910:x1875771218048256:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 311us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.880462:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 103 00000100:00100000:1.0:1788875273.890372:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875273.890468:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048384 00000100:00100000:3.0:1788875273.890477:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048384 00000100:00100000:3.0:1788875273.890529:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:3.0:1788875273.890538:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13910:x1875771218048384:12345-192.168.202.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788875273.890891:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13910:x1875771218048384:12345-192.168.202.7@tcp:502:llog_process_th.0 Request processed in 352us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875273.890899:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 104 00000100:00100000:1.0:1788875273.902624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875273.904884:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048512 00000100:00100000:0.0:1788875273.904912:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048512 00000100:00100000:0.0:1788875273.904987:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1788875273.904996:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875771218048512:12345-192.168.202.7@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788875273.905022:0:14490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d842d8e5-7831-40d7-899a-0f57c20fe6b7@192.168.202.7@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1788875273.905067:0:14490:0:(genops.c:1385:class_connect()) connect: client d842d8e5-7831-40d7-899a-0f57c20fe6b7, cookie 0x60858e6020d83622 00000004:00100000:0.0:1788875273.905100:0:14490:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788875273.905259:0:14490:0:(import.c:65:import_set_state_nolock()) ffff9e5a362c2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788875273.905337:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2346:x1875771218048512:12345-192.168.202.7@tcp:38:mount.lustre.0 Request processed in 340us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875273.905345:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:0.0:1788875273.925981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875273.926363:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.926923:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048640 00000100:00100000:2.0:1788875273.926936:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048640 00000100:00100000:2.0:1788875273.927063:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048768 00000100:00100000:2.0:1788875273.927068:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048768 00000100:00100000:2.0:1788875273.927094:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875273.927105:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+7:0:x1875771218048640:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875273.927137:0:14488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875273.927222:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+7:0:x1875771218048640:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 119us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.927229:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875273.927245:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1788875273.927251:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218048768:12345-192.168.202.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788875273.927274:0:14488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788875273.927295:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218048768:12345-192.168.202.7@tcp:41:mount.lustre.0 Request processed in 44us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.927300:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00080000:0.0:1788875273.928113:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875273.929118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.929323:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218048896 00000100:00100000:2.0:1788875273.929334:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218048896 00000100:00100000:2.0:1788875273.929437:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1788875273.929449:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218048896:12345-192.168.202.7@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788875273.929545:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218048896:12345-192.168.202.7@tcp:40:mount.lustre.0 Request processed in 99us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.929553:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:2.0:1788875273.932901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.932974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875273.933146:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875273.933256:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049280 00000100:00100000:1.0:1788875273.933265:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049280 00000100:00100000:1.0:1788875273.933329:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1788875273.933339:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218049280:12345-192.168.202.7@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788875273.933424:0:14492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788875273.933520:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13901:x1875771218049280:12345-192.168.202.7@tcp:33:mount.lustre.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875273.933527:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:3.0:1788875273.934396:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049024 00000100:00100000:3.0:1788875273.934404:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049024 00000100:00100000:2.0:1788875273.934537:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049152 00000100:00100000:2.0:1788875273.934542:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049152 00000100:00100000:2.0:1788875273.934557:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875273.934564:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875771218049024:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788875273.934592:0:15170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d842d8e5-7831-40d7-899a-0f57c20fe6b7@192.168.202.7@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788875273.934622:0:15170:0:(genops.c:1385:class_connect()) connect: client d842d8e5-7831-40d7-899a-0f57c20fe6b7, cookie 0x60858e6020d83629 00002000:00100000:2.0:1788875273.934633:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d842d8e5-7831-40d7-899a-0f57c20fe6b7/ffff9e5a3cd12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788875273.934644:0:15170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788875273.934762:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788875273.934813:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e5a3cd11800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875273.934875:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2346:x1875771218049024:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 310us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.934894:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875273.934911:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:2.0:1788875273.934916:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875771218049152:12345-192.168.202.7@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788875273.934932:0:15170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d842d8e5-7831-40d7-899a-0f57c20fe6b7@192.168.202.7@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788875273.934950:0:15170:0:(genops.c:1385:class_connect()) connect: client d842d8e5-7831-40d7-899a-0f57c20fe6b7, cookie 0x60858e6020d83630 00002000:00100000:2.0:1788875273.934956:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d842d8e5-7831-40d7-899a-0f57c20fe6b7/ffff9e5a3cd17000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788875273.934963:0:15170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788875273.935156:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788875273.935189:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e5a3cd12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788875273.935215:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2346:x1875771218049152:12345-192.168.202.7@tcp:8:mount.lustre.0 Request processed in 297us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875273.935222:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788875274.112136:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875274.112263:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049408 00000100:00100000:3.0:1788875274.112274:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049408 00000100:00100000:3.0:1788875274.112334:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1788875274.112345:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:13931:x1875771218049408:12345-192.168.202.7@tcp:101:mkdir.0 00010000:00010000:3.0:1788875274.112365:0:16362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875274.112403:0:16362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15400/0x60858e6020d83637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fb2 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112480:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112495:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112510:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875274.112547:0:16362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788875274.112550:0:16362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875274.112575:0:16362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112602:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15400/0x60858e6020d83637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 8 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112619:0:16362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 7 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875274.112627:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:3.0:1788875274.112630:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875274.112634:0:16362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14400, rc 0) 00000100:00100000:3.0:1788875274.112692:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d842d8e5-7831-40d7-899a-0f57c20fe6b7+7:13931:x1875771218049408:12345-192.168.202.7@tcp:101:mkdir.0 Request processed in 349us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875274.112699:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000001:00100000:3.0:1788875274.114754:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d842d8e5-7831-40d7-899a-0f57c20fe6b7 00000001:00100000:3.0:1788875274.114826:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c03ea99-fe93-4040-b0ab-19354d12a812 00010000:00010000:2.0:1788875274.896490:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875275.919472:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788875276.180366:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d842d8e5-7831-40d7-899a-0f57c20fe6b7 00000001:00100000:3.0:1788875276.180390:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c03ea99-fe93-4040-b0ab-19354d12a812 00010000:00010000:2.0:1788875276.945531:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875277.134191:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241109376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788875277.134302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.135613:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109376 00000100:00100000:3.0:1788875277.135630:0:15175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109376 00000100:00100000:3.0:1788875277.135712:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788875277.135724:0:15175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241109376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788875277.135791:0:15175:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788875277.136957:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875277.139736:0:15175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241109376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3996us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875277.139756:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788875277.145682:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241109376:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788875277.250611:0:16453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788875277.649450:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788875277.649488:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241109504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875277.649595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.650520:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241109888:0@lo:400:kworker.0 00000100:00100000:3.0:1788875277.650590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.650624:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788875277.650629:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241110016:0@lo:400:kworker.0 00000100:00100000:3.0:1788875277.650653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.650684:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109888 00000100:00100000:3.0:1788875277.650693:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109888 00000100:00100000:3.0:1788875277.650744:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110016 00000100:00100000:3.0:1788875277.650747:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110016 00000100:00100000:3.0:1788875277.650808:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788875277.650829:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241109888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788875277.650859:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875277.650878:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788875277.650890:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241109888:12345-0@lo:400:kworker.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875277.650890:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875277.650898:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788875277.650924:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875771241110016:12345-0@lo:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875277.650929:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788875277.650991:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875771241110016:0@lo:400:kworker.0 00000100:00100000:3.0:1788875277.651003:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241109888:0@lo:400:kworker.0 00000100:00100000:0.0:1788875277.651025:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109504 00000100:00100000:0.0:1788875277.651030:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109504 00000100:00100000:3.0:1788875277.651043:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241109632:0@lo:400:kworker.0 00000100:00100000:0.0:1788875277.651070:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788875277.651077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875277.651079:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241109504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875277.651101:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241110144:0@lo:400:kworker.0 00002000:00000024:0.0:1788875277.651117:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788875277.651120:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.651148:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875277.651154:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241109760:0@lo:400:kworker.0 00000100:00100000:0.0:1788875277.651172:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241109504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875277.651179:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788875277.651180:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875277.651199:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110144 00000100:00100000:3.0:1788875277.651203:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110144 00000100:00100000:0.0:1788875277.651211:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109632 00000100:00100000:0.0:1788875277.651222:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109632 00000100:00100000:3.0:1788875277.651227:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788875277.651233:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875277.651246:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788875277.651251:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788875277.651262:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875771241110144:12345-0@lo:400:kworker.0 Request processed in 30us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875277.651268:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788875277.651278:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241109632:12345-0@lo:400:kworker.0 Request processed in 27us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875277.651370:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241109760 00000100:00100000:2.0:1788875277.651375:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241109760 00000100:00100000:2.0:1788875277.651410:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788875277.651417:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875277.651459:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241109760:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875277.651466:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788875277.652194:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788875277.652367:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788875277.652372:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788875277.652407:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788875277.652435:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241109504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788875277.657552:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241109760:0@lo:400:kworker.0 00000100:00100000:2.0:1788875277.657587:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cd89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241109632:0@lo:400:kworker.0 00000100:00100000:2.0:1788875277.657604:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875771241110144:0@lo:400:kworker.0 00000001:00100000:2.0:1788875277.755735:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d842d8e5-7831-40d7-899a-0f57c20fe6b7 00010000:00010000:3.0:1788875277.966200:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875278.992530:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788875279.135461:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135515:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135550:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135573:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135595:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135642:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875279.135679:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049664 00000100:00100000:1.0:1788875279.135692:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049664 00000100:00100000:1.0:1788875279.135762:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050048 00000100:00100000:1.0:1788875279.135764:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050048 00000100:00100000:1.0:1788875279.135825:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1788875279.135837:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2347:x1875771218049664:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.135932:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2347:x1875771218049664:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 97us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.135941:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:1.0:1788875279.135961:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1788875279.135968:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2347:x1875771218050048:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.135990:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2347:x1875771218050048:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.136007:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:1.0:1788875279.136030:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049920 00000100:00100000:1.0:1788875279.136034:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049920 00000100:00100000:1.0:1788875279.136054:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050176 00000100:00100000:1.0:1788875279.136057:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050176 00000100:00100000:1.0:1788875279.136071:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049792 00000100:00100000:1.0:1788875279.136074:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049792 00000100:00100000:1.0:1788875279.136085:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050304 00000100:00100000:1.0:1788875279.136087:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050304 00000100:00100000:1.0:1788875279.136101:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875279.136107:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218049920:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.136146:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218049920:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 39us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.136152:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875279.136164:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875279.136169:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2347:x1875771218050176:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.136188:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2347:x1875771218050176:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 20us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.136194:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875279.136201:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788875279.136208:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218049792:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.136225:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218049792:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 20us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.136231:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788875279.136239:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:1.0:1788875279.136250:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2347:x1875771218050304:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:1.0:1788875279.136269:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2347:x1875771218050304:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 20us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875279.136274:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00080000:1.0:1788875279.136299:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788875279.136304:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788875279.136307:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875279.136559:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218049536 00000100:00100000:2.0:1788875279.136566:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218049536 00000100:00100000:2.0:1788875279.136601:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 106 00000100:00100000:2.0:1788875279.136608:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2348:x1875771218049536:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:2.0:1788875279.136636:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2348:x1875771218049536:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 29us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875279.136642:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 106 00010000:00010000:1.0:1788875280.014271:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875281.038522:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788875281.309617:0:16602:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc598d8f40 20000000:00000080:3.0:1788875281.309644:0:16602:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5904fbc400 uarg=0000000000000000 20000000:01000000:3.0:1788875281.309693:0:16602:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788875281.309701:0:16602:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788875281.309706:0:16602:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788875281.312097:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788875281.313724:0:16602:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788875281.324621:0:16602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788875281.324667:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324718:0:16602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83335 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324727:0:16602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83382 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324734:0:16602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324745:0:16602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324753:0:16602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324761:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324859:0:16602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.324878:0:16602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 12 pid: 14481 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.324896:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110272:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875281.325061:0:16602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 12 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325070:0:16602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 12 pid: 14482 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.325087:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110400:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875281.325148:0:16602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325156:0:16602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.325166:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110528:0@lo:104: 00000100:00100000:3.0:1788875281.325217:0:16602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788875281.325246:0:16602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325253:0:16602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 18 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.325261:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110656:0@lo:104: 00000100:00100000:3.0:1788875281.325280:0:16602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875281.325316:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110528 00000100:00100000:3.0:1788875281.325325:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110528 00000100:00100000:3.0:1788875281.325379:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110656 00000100:00100000:3.0:1788875281.325382:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110656 00000100:00100000:3.0:1788875281.325398:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788875281.325408:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+4:16602:x1875771241110528:12345-0@lo:104: 00010000:00010000:3.0:1788875281.325425:0:14472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325492:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788875281.325499:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+4:16602:x1875771241110528:12345-0@lo:104: Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875281.325513:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788875281.325554:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788875281.325560:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:16602:x1875771241110656:12345-0@lo:104: 00010000:00010000:3.0:1788875281.325567:0:14472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325603:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788875281.325608:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:16602:x1875771241110656:12345-0@lo:104: Request processed in 49us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875281.325614:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788875281.325633:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788875281.325639:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325647:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0200 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875281.325652:0:14476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325663:0:14476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875281.325670:0:14476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875281.325676:0:14476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788875281.325710:0:14476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325717:0:14476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875281.325747:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325754:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a04ee0200/0x60858e6020d834b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d834bd expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325812:0:14476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788875281.325816:0:14476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325822:0:14476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35b34600 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:3.0:1788875281.325824:0:14476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325831:0:14476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788875281.325837:0:14476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875281.325843:0:14476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788875281.325857:0:14476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325863:0:14476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788875281.325876:0:14476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.325883:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35b34600/0x60858e6020d83382 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d83389 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875281.325886:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875281.325904:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875281.325906:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875281.325908:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875281.325927:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875281.325943:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241110784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875281.325976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875281.326052:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110784 00010000:00010000:3.0:1788875281.326056:0:16602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875281.326057:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110784 00010000:00010000:3.0:1788875281.326066:0:16602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.326075:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241111040:0@lo:104: 00010000:00010000:2.0:1788875281.326081:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875281.326115:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788875281.326122:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241110784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788875281.326135:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875281.326141:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875281.326151:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875281.326182:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875281.326222:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+19:3305:x1875771241110784:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875281.326229:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788875281.330536:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241110912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875281.330665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875281.330875:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241110912 00000100:00100000:0.0:1788875281.330887:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241110912 00010000:00010000:0.0:1788875281.330938:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875281.330983:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788875281.330993:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23009a34-c6dd-4af5-b962-084fb475da02+19:3303:x1875771241110912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788875281.331011:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875281.331018:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.331033:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 19 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.331070:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875281.331153:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23009a34-c6dd-4af5-b962-084fb475da02+19:3303:x1875771241110912:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875281.331161:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788875281.331229:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23009a34-c6dd-4af5-b962-084fb475da02:3303:1875771241110912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788875281.332052:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241110784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788875281.343261:0:16602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875281.343740:0:16602:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1788875281.343890:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee1400/0x60858e6020d834bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d834b6 expref: 18 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.343910:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110528:0@lo:104: 00010000:00010000:3.0:1788875281.343928:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a35b35c00/0x60858e6020d83389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d83382 expref: 17 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.343937:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110656:0@lo:104: 00000100:00100000:1.0:1788875281.344209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875281.344247:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875281.344299:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050560 00000100:00100000:1.0:1788875281.344309:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050560 00010000:00010000:1.0:1788875281.344360:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 13 pid: 14482 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875281.344392:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050432 00000100:00100000:1.0:1788875281.344395:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050432 00010000:00010000:1.0:1788875281.344410:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 14 pid: 14481 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875281.344425:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875281.344435:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36269c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:287afd9b-867a-48fc-8e7f-a9e11341315a+14:2348:x1875771218050560:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875281.344452:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875281.344459:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 14 pid: 14482 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.344470:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 14 pid: 14482 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.344519:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875281.344586:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36269c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:287afd9b-867a-48fc-8e7f-a9e11341315a+14:2348:x1875771218050560:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 151us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875281.344593:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875281.344662:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875281.344669:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2348:x1875771218050432:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875281.344676:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788875281.344680:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 13 pid: 14481 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.344690:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 13 pid: 14481 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.344700:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875281.344717:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2348:x1875771218050432:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875281.344723:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00010000:00010000:3.0:1788875281.345348:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a14600/0x60858e6020d8361b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f88 expref: 12 pid: 14481 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.345366:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110272:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875281.345398:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d835e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f26 expref: 11 pid: 14482 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875281.345408:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241110400:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875281.346035:0:14472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788875281.346059:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111040 00000100:00100000:0.0:1788875281.346067:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111040 00000100:00100000:0.0:1788875281.346171:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788875281.346182:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a1b681850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:16602:x1875771241111040:12345-0@lo:104: 00010000:00010000:0.0:1788875281.346199:0:14472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.346301:0:14472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788875281.346307:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a1b681850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23009a34-c6dd-4af5-b962-084fb475da02+3:16602:x1875771241111040:12345-0@lo:104: Request processed in 129us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875281.346315:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788875281.346387:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788875281.346396:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.346404:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c44000 already unused, calling callback (ffffffffc1d58c20) 10000000:00010000:1.0:1788875281.346409:0:14477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.346418:0:14477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788875281.346442:0:14477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788875281.346449:0:14477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788875281.346496:0:14477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.346504:0:14477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788875281.346528:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.346535:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.107@tcp lock: ffff9e5a35c44000/0x60858e6020d83335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x60858e6020d8333c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875281.346555:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875281.346558:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788875281.346560:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788875281.346653:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16602:1875771241111040:0@lo:104: 00010000:00010000:2.0:1788875281.346702:0:16602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875281.347214:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241111168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788875281.347287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875281.347509:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111168 00000100:00100000:1.0:1788875281.347518:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111168 00010000:00010000:0.0:1788875281.347654:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 17 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875281.347732:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788875281.347742:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+17:3304:x1875771241111168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788875281.347757:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875281.347762:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 17 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.347983:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 17 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348004:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a04ee0400/0x60858e6020d8333c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x60858e6020d83335 expref: 17 pid: 14483 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348022:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348031:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348051:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348060:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348068:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348075:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348082:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15400 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875281.348087:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.348096:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.350354:0:16602:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875281.350378:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.355694:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.355720:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5a13a15400/0x60858e6020d83645 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875281.355750:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875281.356137:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23009a34-c6dd-4af5-b962-084fb475da02+16:3304:x1875771241111168:12345-0@lo:103:ldlm_bl.0 Request processed in 8389us (8842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875281.356150:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788875281.356245:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23009a34-c6dd-4af5-b962-084fb475da02:3304:1875771241111168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788875282.062338:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875282.255174:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788875282.255210:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875282.255311:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875282.255405:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111296 00000100:00100000:0.0:1788875282.255418:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111296 00000100:00100000:0.0:1788875282.255490:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788875282.255502:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241111296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875282.255556:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875282.255612:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875771241111296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875282.255621:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788875282.255651:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875282.255697:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875771241111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788875282.415210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875282.415878:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050688 00000100:00100000:0.0:1788875282.415893:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050688 00000100:00100000:0.0:1788875282.415974:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:0.0:1788875282.415986:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+11:13786:x1875771218050688:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875282.416008:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875282.416050:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d8364c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fb9 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875282.416087:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d8364c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb9 expref: 12 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875282.416468:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee0a00/0x60858e6020d8364c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb9 expref: 12 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875282.416481:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0a00, rc 0) 00000100:00100000:0.0:1788875282.416604:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218050688:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 619us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875282.416613:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 107 00000100:00100000:3.0:1788875282.431358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875282.431761:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050816 00000100:00100000:2.0:1788875282.431790:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050816 00000100:00100000:2.0:1788875282.438519:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:2.0:1788875282.438555:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218050816:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875282.439051:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218050816:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 511us (7706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875282.439062:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 108 00000100:00100000:3.0:1788875282.442448:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875282.443939:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218050944 00000100:00100000:1.0:1788875282.443961:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218050944 00000100:00100000:1.0:1788875282.444040:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:1.0:1788875282.444052:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218050944:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875282.444699:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218050944:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 643us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875282.444710:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 109 00000100:00100000:3.0:1788875282.452127:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875282.454511:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051072 00000100:00100000:1.0:1788875282.454531:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051072 00000100:00100000:1.0:1788875282.454628:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:1.0:1788875282.454641:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a109cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+12:13786:x1875771218051072:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875282.454665:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875282.454689:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a35a18000/0x60858e6020d83653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fc0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875282.454729:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a35a18000/0x60858e6020d83653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fc0 expref: 13 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875282.454742:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a35a18000/0x60858e6020d83653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fc0 expref: 13 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875282.454753:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18000, rc 0) 00000100:00100000:1.0:1788875282.454860:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a109cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13786:x1875771218051072:12345-192.168.202.7@tcp:101:ll_cfg_requeue.0 Request processed in 221us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875282.454868:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 110 00000100:00100000:3.0:1788875282.462221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875282.462342:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051200 00000100:00100000:2.0:1788875282.462356:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051200 00000100:00100000:2.0:1788875282.462429:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 111 00000100:00100000:2.0:1788875282.462442:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a0293d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13786:x1875771218051200:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788875282.463264:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a0293d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13786:x1875771218051200:12345-192.168.202.7@tcp:501:ll_cfg_requeue.0 Request processed in 818us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875282.463285:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 111 00000100:00100000:0.0:1788875282.474308:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875282.474424:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051328 00000100:00100000:2.0:1788875282.474438:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051328 00000100:00100000:2.0:1788875282.474511:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:2.0:1788875282.474524:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13786:x1875771218051328:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788875282.474843:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:287afd9b-867a-48fc-8e7f-a9e11341315a+13:13786:x1875771218051328:12345-192.168.202.7@tcp:503:ll_cfg_requeue.0 Request processed in 321us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875282.474855:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 112 00000100:00100000:3.0:1788875282.780971:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788875282.781007:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241111808:0@lo:400:kworker.0 00000100:00100000:3.0:1788875282.781118:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875282.781125:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241111552:0@lo:400:kworker.0 00000100:00100000:0.0:1788875282.781164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875282.781182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788875282.781190:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788875282.781195:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241111680:0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.781266:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241111936:0@lo:400:kworker.0 00000100:00100000:3.0:1788875282.785575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875282.787423:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111424 00000100:00100000:2.0:1788875282.787444:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111424 00000100:00100000:2.0:1788875282.787519:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788875282.787532:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:3305:x1875771241111424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.796126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875282.796261:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111808 00000100:00100000:1.0:1788875282.796273:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111808 00000100:00100000:1.0:1788875282.796363:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111936 00000100:00100000:1.0:1788875282.796366:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111936 00000100:00100000:1.0:1788875282.796390:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788875282.796401:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241111808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.796484:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241111808:12345-0@lo:400:kworker.0 Request processed in 85us (15366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875282.796492:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788875282.796511:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788875282.796526:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241111936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.796564:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241111936:12345-0@lo:400:kworker.0 Request processed in 40us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875282.796570:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788875282.796591:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111552 00000100:00100000:1.0:1788875282.796595:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111552 00000100:00100000:1.0:1788875282.796836:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788875282.796846:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241111552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875282.800804:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+16:3305:x1875771241111424:12345-0@lo:400:kworker.0 Request processed in 13261us (15225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875282.800824:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788875282.801786:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875282.801834:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241111680 00000100:00100000:3.0:1788875282.801847:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241111680 00000100:00080000:0.0:1788875282.801913:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788875282.801919:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788875282.801921:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875282.801928:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788875282.801930:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241111680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788875282.801944:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241112064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788875282.801997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875282.802003:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875771241111680:12345-0@lo:400:kworker.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875282.802011:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788875282.802025:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112064 00000100:00100000:0.0:1788875282.802029:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112064 00000100:00100000:0.0:1788875282.802061:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788875282.802068:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241112064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788875282.802133:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875282.802189:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875771241112064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875282.802196:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788875282.802243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875771241111680:0@lo:400:kworker.0 00000100:00100000:3.0:1788875282.802248:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875771241112064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875282.803519:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241111808:0@lo:400:kworker.0 00000100:00100000:3.0:1788875282.803540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23009a34-c6dd-4af5-b962-084fb475da02:3305:1875771241111424:0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.808141:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241111552:12345-0@lo:400:kworker.0 Request processed in 11278us (26956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875282.808163:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788875282.808268:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788875282.808336:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241111936:0@lo:400:kworker.0 00010000:00010000:2.0:1788875283.090024:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788875283.214834:0:14485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788875283.214845:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a3f777800 from 10 10000000:01000000:1.0:1788875283.214851:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788875283.214979:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875283.214992:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875283.215006:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875283.215038:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.215150:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875283.215242:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813840 going to sleep for 11 seconds 00000100:00100000:0.0:1788875283.215423:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112192 00000100:00100000:0.0:1788875283.215434:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112192 00000100:00100000:0.0:1788875283.215565:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788875283.215577:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+16:14485:x1875771241112192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875283.215595:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875283.215614:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1e00/0x60858e6020d83661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d8365a expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.215646:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1e00/0x60858e6020d83661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d8365a expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.215659:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee1e00/0x60858e6020d83661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d8365a expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.215670:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1e00, rc 0) 00000100:00100000:0.0:1788875283.215730:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875283.215737:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788875283.215827:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875283.215846:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83661 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875283.215857:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d83661 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875283.217362:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.217436:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875283.219695:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813840 going to sleep for 11 seconds 00000100:00100000:3.0:1788875283.220052:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112320 00000100:00100000:3.0:1788875283.220065:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112320 00000100:00100000:3.0:1788875283.220158:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788875283.220170:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.220563:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (3126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875283.220571:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788875283.220823:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.220902:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.220958:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875283.220986:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813840 going to sleep for 11 seconds 00000100:00100000:3.0:1788875283.221207:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112448 00000100:00100000:3.0:1788875283.221213:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112448 00000100:00100000:3.0:1788875283.221239:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788875283.221246:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.221430:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875283.221439:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788875283.221582:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788875283.222552:0:16671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788875283.223668:0:14485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788875283.223705:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788875283.223722:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83661 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.223736:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a35a19c00/0x60858e6020d8365a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d83661 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875283.223749:0:14485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788875283.223752:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5a06642800 from 10 10000000:01000000:3.0:1788875283.223799:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788875283.223850:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.223859:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.223871:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875283.224145:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.224214:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875283.224265:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788875283.224362:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112576 00000100:00100000:0.0:1788875283.224373:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112576 00000100:00100000:0.0:1788875283.224433:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788875283.224443:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+17:14485:x1875771241112576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875283.224471:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875283.224489:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5a04ee1000/0x60858e6020d8366f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83668 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.224521:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5a04ee1000/0x60858e6020d8366f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83668 expref: 18 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.224533:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5a04ee1000/0x60858e6020d8366f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83668 expref: 18 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.224542:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1000, rc 0) 00000100:00100000:0.0:1788875283.224594:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875283.224601:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788875283.224992:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788875283.225012:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8366f expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875283.225023:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8366f expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875283.225107:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.225154:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875283.225194:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813840 going to sleep for 11 seconds 00000100:00100000:3.0:1788875283.225545:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112704 00000100:00100000:3.0:1788875283.225551:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112704 00000100:00100000:3.0:1788875283.225595:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788875283.225605:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.226145:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 540us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875283.226154:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788875283.226315:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.226368:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.226425:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875283.226461:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04813840 going to sleep for 11 seconds 00000100:00100000:3.0:1788875283.226513:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112832 00000100:00100000:3.0:1788875283.226519:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112832 00000100:00100000:3.0:1788875283.226556:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788875283.226564:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.227264:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 698us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875283.227273:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788875283.227494:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3cdbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788875283.228496:0:16672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788875283.228703:0:14485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788875283.228743:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788875283.228757:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8366f expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.228962:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14600/0x60858e6020d83668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8366f expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788875283.228976:0:14485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788875283.228980:0:14485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e59064ff800 from 10 10000000:01000000:3.0:1788875283.228983:0:14485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788875283.229031:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.229041:0:14485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.229053:0:14485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875283.229091:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.229173:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875283.229293:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788875283.232483:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241112960 00000100:00100000:0.0:1788875283.232504:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241112960 00000100:00100000:2.0:1788875283.232736:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788875283.232750:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+18:14485:x1875771241112960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788875283.232821:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875283.232859:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5907849e00/0x60858e6020d8367d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x60858e6020d83676 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875283.232913:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5907849e00/0x60858e6020d8367d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x60858e6020d83676 expref: 19 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875283.232927:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5907849e00/0x60858e6020d8367d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x60858e6020d83676 expref: 19 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875283.232956:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907849e00, rc 0) 00000100:00100000:2.0:1788875283.233094:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241112960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875283.233102:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788875283.233367:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d3d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241112960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788875283.233397:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8367d expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875283.233409:0:14485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x60858e6020d8367d expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875283.233523:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241113088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875283.233575:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875283.234378:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875283.234435:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241113088 00000100:00100000:1.0:1788875283.234447:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241113088 00000100:00100000:1.0:1788875283.234506:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788875283.234517:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241113088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788875283.235362:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241113088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 843us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875283.235372:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788875283.235458:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241113088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788875283.235534:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241113216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788875283.235590:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875283.235667:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a3585af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875283.235737:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241113216 00000100:00100000:2.0:1788875283.235744:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241113216 00000100:00100000:3.0:1788875283.236225:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788875283.236241:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241113216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788875283.236475:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23009a34-c6dd-4af5-b962-084fb475da02+19:14485:x1875771241113216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875283.236484:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788875283.236608:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23009a34-c6dd-4af5-b962-084fb475da02:14485:1875771241113216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788875283.245625:0:16673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788875283.246908:0:14485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788875283.246954:0:14485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788875283.246985:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8367d expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875283.247002:0:14485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.107@tcp lock: ffff9e5a13a14200/0x60858e6020d83676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x60858e6020d8367d expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788875283.599055:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788875284.110303:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875284.261326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875284.261380:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875284.261417:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051456 00000100:00100000:0.0:1788875284.261430:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051456 00000100:00100000:0.0:1788875284.261520:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:0.0:1788875284.261532:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2349:x1875771218051456:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.262166:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2349:x1875771218051456:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 631us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.262177:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 123 00000100:00100000:1.0:1788875284.262527:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051712 00000100:00100000:1.0:1788875284.262535:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051712 00000100:00100000:1.0:1788875284.262596:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:1.0:1788875284.262606:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218051712:12345-192.168.202.7@tcp:400:kworker.0 00000100:00080000:0.0:1788875284.264070:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788875284.266486:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875284.266564:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875284.266594:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875284.266612:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875284.266634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875284.266829:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051968 00000100:00100000:0.0:1788875284.266842:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051968 00000100:00100000:0.0:1788875284.266915:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051584 00000100:00100000:0.0:1788875284.266918:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051584 00000100:00100000:0.0:1788875284.266947:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1788875284.266959:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2349:x1875771218051968:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.267049:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2349:x1875771218051968:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 91us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.267057:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1788875284.267089:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:0.0:1788875284.267096:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2349:x1875771218051584:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.267123:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2349:x1875771218051584:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.267149:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:0.0:1788875284.267179:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267189:0:15172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788875284.267322:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052224 00000100:00100000:0.0:1788875284.267326:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052224 00000100:00100000:0.0:1788875284.267346:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267351:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218051840 00000100:00100000:0.0:1788875284.267353:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218051840 00000100:00100000:0.0:1788875284.267363:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267368:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052096 00000100:00100000:0.0:1788875284.267370:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052096 00000100:00100000:0.0:1788875284.267383:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267389:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788875284.267395:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218052224:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.267421:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218052224:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 26us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.267427:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788875284.267436:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267441:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875284.267447:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218051840:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.267470:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218051840:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 23us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.267475:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875284.267484:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875284.267490:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1788875284.267496:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218052096:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875284.267521:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218052096:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 25us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875284.267534:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00080000:3.0:1788875284.268250:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788875284.268257:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788875284.268260:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788875284.270479:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218051712:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 7852us (9076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875284.270499:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00010000:00010000:2.0:1788875285.134582:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788875285.170259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.170395:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052352 00000100:00100000:0.0:1788875285.170413:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052352 00000100:00100000:0.0:1788875285.170511:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:0.0:1788875285.170522:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:14441:x1875771218052352:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875285.170549:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.170575:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d83684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fc7 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170764:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170818:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170833:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170849:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170853:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.170858:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171480:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83699 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171503:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83699 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171511:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83699 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.171544:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875285.171548:0:14488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875285.171594:0:14488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83699 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171607:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171812:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171820:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171827:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.171832:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171842:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171859:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875285.171862:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.171868:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171886:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8368b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171903:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171909:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171916:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171940:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.171944:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.171952:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.172106:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.172110:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.172113:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.172119:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.172170:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d83684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fc7 expref: 8 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.172202:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0600/0x60858e6020d83699 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fc7 expref: 7 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.172211:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a0bc0d100) 00010000:00010000:0.0:1788875285.172213:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875285.172215:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0600, rc 0) 00000100:00100000:0.0:1788875285.172389:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:14441:x1875771218052352:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 1867us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.172399:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:2.0:1788875285.177405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.177546:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052608 00000100:00100000:0.0:1788875285.177562:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052608 00000100:00100000:0.0:1788875285.177697:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:0.0:1788875285.177711:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+7:14441:x1875771218052608:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875285.177764:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.177850:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fce expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.177980:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178007:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178021:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178252:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178294:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178307:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178706:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d836b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178716:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d836b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.178723:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d836b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.178734:0:14490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788875285.179035:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179043:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179049:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179055:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.179059:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179079:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179103:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e5a0bc0d100) 00010000:00010000:0.0:1788875285.179106:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.179111:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179118:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179131:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179138:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179144:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179150:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.179153:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179159:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179167:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.179169:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.179172:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179178:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179667:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fce expref: 10 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179685:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0200/0x60858e6020d836b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fce expref: 9 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.179693:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875285.179695:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.179697:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0200, rc 0) 00000100:00100000:0.0:1788875285.179808:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14441:x1875771218052608:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 2064us (2379us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788875285.179817:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1788875285.195168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.195703:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052736 00000100:00100000:0.0:1788875285.195718:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052736 00000100:00100000:0.0:1788875285.195823:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1788875285.195834:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14441:x1875771218052736:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788875285.195946:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14441:x1875771218052736:12345-192.168.202.7@tcp:59:lhsmtool_posix.0 Request processed in 114us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.195953:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:3.0:1788875285.236667:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.236850:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052864 00000100:00100000:0.0:1788875285.236869:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052864 00000100:00100000:0.0:1788875285.236949:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875285.236958:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14447:x1875771218052864:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875285.236976:0:14489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.237004:0:14489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fd5 expref: -99 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237102:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237117:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237128:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237147:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237155:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237161:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237372:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237382:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237389:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237395:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.237401:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237419:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237434:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875285.237437:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.237443:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237450:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d836ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237463:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237470:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237475:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237479:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.237483:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237489:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237496:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.237499:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.237502:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237518:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d836d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237561:0:14489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fd5 expref: 10 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237571:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875285.237574:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.237578:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fd5 expref: 10 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.237588:0:14489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0800, rc 0) 00000100:00100000:0.0:1788875285.237697:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14447:x1875771218052864:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 739us (1047us total) trans 0 rc 301/301 00000100:00100000:0.0:1788875285.237705:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:2.0:1788875285.245287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.245466:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218052992 00000100:00100000:3.0:1788875285.245475:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218052992 00000100:00100000:3.0:1788875285.245531:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1788875285.245539:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14447:x1875771218052992:12345-192.168.202.7@tcp:700:lfs.0 00000100:00100000:3.0:1788875285.245661:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14447:x1875771218052992:12345-192.168.202.7@tcp:700:lfs.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875285.245668:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1788875285.248523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.249156:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218053248 00000100:00100000:0.0:1788875285.249168:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218053248 00000100:00100000:0.0:1788875285.249272:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1788875285.249283:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14447:x1875771218053248:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:0.0:1788875285.249364:0:16362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875285.249393:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d83606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0f50 expref: 9 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.249412:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875285.249417:0:16362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875285.249632:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.249653:0:16362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 5 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.249661:0:16362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.249695:0:16362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 5 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.249710:0:16362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 5 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.249722:0:16362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16362:1875771241113344:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875285.249870:0:16362:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a057abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788875285.256362:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.256734:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218053376 00000100:00100000:3.0:1788875285.256763:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218053376 00010000:00010000:3.0:1788875285.256816:0:14475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 6 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.256860:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:3.0:1788875285.256868:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2348:x1875771218053376:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875285.256882:0:14475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875285.256888:0:14475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 6 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.256899:0:14475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 6 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.256920:0:14475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:3.0:1788875285.256925:0:14475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.256933:0:14475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.256940:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.256957:0:14475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875285.257005:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2348:x1875771218053376:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 138us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875285.257011:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00010000:00010000:0.0:1788875285.258034:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14400/0x60858e6020d8363e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fb2 expref: 5 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.258051:0:16362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35970380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16362:1875771241113344:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875285.258081:0:16362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.258089:0:16362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.258094:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.258118:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.258138:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.258147:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.261354:0:16362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788875285.261377:0:16362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.261388:0:16362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.261397:0:16362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.261404:0:16362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.261409:0:16362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.262131:0:16362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.262155:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:0.0:1788875285.262158:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.262165:0:16362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.262172:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875285.262218:0:16362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f8bcac0 reply state 000000003b2813cf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.262227:0:16362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875285.262364:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+10:14447:x1875771218053248:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 13079us (13846us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788875285.262373:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00010000:00010000:0.0:1788875285.269697:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269718:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269725:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269732:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.269737:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269746:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269768:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.269815:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.269823:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.269830:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.367924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.368314:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218053504 00000100:00100000:0.0:1788875285.368325:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218053504 00000100:00100000:0.0:1788875285.368399:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:0.0:1788875285.368411:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+9:14455:x1875771218053504:12345-192.168.202.7@tcp:101:lctl.0 00010000:00010000:0.0:1788875285.368444:0:14489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.368471:0:14489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fdc expref: -99 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368538:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368553:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368564:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.368599:0:14489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875285.368602:0:14489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875285.368641:0:14489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368666:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d836e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fdc expref: 11 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368683:0:14489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0800/0x60858e6020d836ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fdc expref: 10 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.368692:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.368710:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788875285.368714:0:14489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0800, rc 0) 00000100:00100000:0.0:1788875285.369005:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+10:14455:x1875771218053504:12345-192.168.202.7@tcp:101:lctl.0 Request processed in 595us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.369013:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 20 00000100:00100000:2.0:1788875285.402527:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.402677:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218053632 00000100:00100000:3.0:1788875285.402703:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218053632 00000100:00100000:3.0:1788875285.402816:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875285.402827:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:14456:x1875771218053632:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875285.402848:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875285.402879:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d836f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fe3 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.402949:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d836fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.402964:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d836fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.402977:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d836fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875285.403015:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788875285.403019:0:14488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788875285.403043:0:14488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d836fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.403092:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d836f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fe3 expref: 7 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.403112:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14000/0x60858e6020d836fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fe3 expref: 6 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.403121:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:3.0:1788875285.403124:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788875285.403129:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14000, rc 0) 00000100:00100000:3.0:1788875285.403195:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:14456:x1875771218053632:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 370us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875285.403203:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 21 00000100:00100000:3.0:1788875285.408473:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.408563:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218053760 00000100:00100000:2.0:1788875285.408638:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218053760 00000100:00100000:2.0:1788875285.408699:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:2.0:1788875285.408709:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:14456:x1875771218053760:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875285.408728:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875285.408969:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849200/0x60858e6020d83702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fea expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409046:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409069:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409086:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409125:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409133:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409139:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409272:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409280:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409286:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875285.409312:0:14490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788875285.409316:0:14490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875285.409333:0:14490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409344:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409351:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409357:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409373:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875285.409377:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409386:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409399:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:2.0:1788875285.409402:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875285.409407:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409414:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409427:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409433:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409438:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409443:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875285.409446:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409451:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409469:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5a08410c00) 00010000:00010000:2.0:1788875285.409472:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875285.409475:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409481:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d83710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409512:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849200/0x60858e6020d83702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fea expref: 8 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409525:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fea expref: 7 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.409533:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410400) 00010000:00010000:2.0:1788875285.409535:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875285.409538:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907849c00, rc 0) 00000100:00100000:2.0:1788875285.409999:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+7:14456:x1875771218053760:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1289us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875285.410008:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 22 00000100:00100000:1.0:1788875285.424133:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.424231:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218054016 00000100:00100000:3.0:1788875285.424242:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218054016 00000100:00100000:3.0:1788875285.424308:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1788875285.424319:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+7:14456:x1875771218054016:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:3.0:1788875285.424341:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875285.424364:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d8371e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ff1 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875285.424474:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788875285.424608:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d8371e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ff1 expref: 9 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.424622:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:3.0:1788875285.424625:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788875285.424630:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d8371e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ff1 expref: 9 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.424646:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a14c00, rc 0) 00000100:00100000:3.0:1788875285.424815:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+8:14456:x1875771218054016:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 452us (649us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788875285.424824:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 23 00000100:00100000:3.0:1788875285.434366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.434500:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218054272 00000100:00100000:0.0:1788875285.434513:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218054272 00000100:00100000:0.0:1788875285.434595:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 24 00000100:00100000:0.0:1788875285.434607:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+8:14456:x1875771218054272:12345-192.168.202.7@tcp:36:lfs.0 00010000:00010000:0.0:1788875285.434669:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875285.434702:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849c00/0x60858e6020d83717 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fea expref: 8 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.434723:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410400) 00010000:00010000:0.0:1788875285.434734:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875285.434818:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.434834:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.434845:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875285.435326:0:14489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000265eaeeb reply state 00000000910a27e8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.435335:0:14489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788875285.435343:0:14489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788875285.435435:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+9:14456:x1875771218054272:12345-192.168.202.7@tcp:36:lfs.0 Request processed in 831us (1080us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788875285.435459:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 24 00010000:00010000:1.0:1788875285.440008:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440041:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440049:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440056:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875285.440073:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440082:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440103:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a0bc0d300) 00010000:00010000:1.0:1788875285.440106:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788875285.440112:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875285.440119:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d8372c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.445354:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.445477:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218054528 00000100:00100000:2.0:1788875285.445488:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218054528 00000100:00100000:2.0:1788875285.445591:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:2.0:1788875285.445602:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+8:14456:x1875771218054528:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875285.446121:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+9:14456:x1875771218054528:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 519us (776us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788875285.446130:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:3.0:1788875285.450563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.450702:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218054784 00000100:00100000:0.0:1788875285.450712:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218054784 00000100:00100000:0.0:1788875285.450824:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:0.0:1788875285.450837:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+9:14456:x1875771218054784:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875285.450872:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.450896:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0ff8 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.450978:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.450994:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451007:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451023:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451030:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451037:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.451169:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788875285.451273:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451297:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451304:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451309:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.451314:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451322:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451335:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.451338:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.451342:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451347:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8373a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451361:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451366:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451373:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451378:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.451387:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451394:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451403:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875285.451405:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.451408:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451415:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451458:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83733 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ff8 expref: 11 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451470:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.451472:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875285.451476:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0ff8 expref: 11 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.451486:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1200, rc 0) 00000100:00100000:0.0:1788875285.451552:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+10:14456:x1875771218054784:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 718us (1001us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788875285.451560:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 25 00000100:00100000:3.0:1788875285.454345:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.454471:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218054912 00000100:00100000:2.0:1788875285.454482:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218054912 00000100:00100000:2.0:1788875285.454583:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:2.0:1788875285.454595:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+10:14456:x1875771218054912:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875285.454620:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875285.454644:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d8374f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a0fff expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454737:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454762:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454807:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875285.454837:0:14490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788875285.454841:0:14490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875285.454869:0:14490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454897:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849000/0x60858e6020d8374f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 12 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454914:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.454924:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410c00) 00010000:00010000:2.0:1788875285.454926:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788875285.454944:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848400, rc 0) 00000100:00100000:2.0:1788875285.455004:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+11:14456:x1875771218054912:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 410us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875285.455011:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 26 00000100:00100000:3.0:1788875285.458829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875285.458971:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055040 00000100:00100000:1.0:1788875285.458982:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055040 00000100:00100000:1.0:1788875285.459048:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1788875285.459073:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+11:14456:x1875771218055040:12345-192.168.202.7@tcp:37:lfs.0 00000100:00100000:0.0:1788875285.463295:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d842d8e5-7831-40d7-899a-0f57c20fe6b7+11:14456:x1875771218055040:12345-192.168.202.7@tcp:37:lfs.0 Request processed in 4225us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.463309:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:1.0:1788875285.467576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.467667:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055296 00000100:00100000:3.0:1788875285.467677:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055296 00000100:00100000:3.0:1788875285.467749:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1788875285.467760:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34eff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+11:14456:x1875771218055296:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875285.468357:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34eff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+12:14456:x1875771218055296:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 597us (791us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788875285.468366:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1788875285.530975:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.531139:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055424 00000100:00100000:0.0:1788875285.531153:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055424 00000100:00100000:0.0:1788875285.531228:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:0.0:1788875285.531237:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+10:14462:x1875771218055424:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875285.531256:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.531274:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d8375d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1006 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531334:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531346:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531355:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531366:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531373:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531379:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531496:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83772 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531503:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531531:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.531570:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788875285.531575:0:14488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875285.531618:0:14488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531633:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531642:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531650:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531656:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.531661:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531668:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531680:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:0.0:1788875285.531683:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.531687:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531693:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d83764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531717:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531723:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531728:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531732:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee0400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.531735:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531741:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531748:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875285.531750:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.531754:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.531759:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8376b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.534310:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d8375d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1006 expref: 12 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.534346:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1200/0x60858e6020d83772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1006 expref: 11 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.534379:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410c00) 00010000:00010000:0.0:1788875285.534383:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788875285.534388:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1200, rc 0) 00000100:00100000:0.0:1788875285.534512:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14462:x1875771218055424:12345-192.168.202.7@tcp:101:bash.0 Request processed in 3274us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.534900:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 27 00000100:00100000:0.0:1788875285.544293:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.544428:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055680 00000100:00100000:3.0:1788875285.544439:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055680 00000100:00100000:3.0:1788875285.544506:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 28 00000100:00100000:3.0:1788875285.544519:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14462:x1875771218055680:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:3.0:1788875285.544545:0:14489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875285.544568:0:14489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d83779 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a100d expref: -99 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.544738:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.544766:0:14489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.544799:0:14489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.544871:0:14489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.544889:0:14489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 11 pid: 14490 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.544907:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113472:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875285.545318:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788875285.547930:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113472:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875285.547991:0:14489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.550441:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.552726:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055808 00000100:00100000:3.0:1788875285.552753:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055808 00010000:00010000:3.0:1788875285.552856:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 12 pid: 14490 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.552981:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:3.0:1788875285.552993:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+12:2347:x1875771218055808:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788875285.553012:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788875285.553020:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 12 pid: 14490 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553035:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 12 pid: 14490 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553088:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848400/0x60858e6020d83756 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a0fff expref: 12 pid: 14490 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553105:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410c00) 00010000:00010000:3.0:1788875285.553111:0:14473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553122:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553131:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875285.553165:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788875285.553238:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d842d8e5-7831-40d7-899a-0f57c20fe6b7+11:2347:x1875771218055808:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 247us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875285.553246:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00010000:00010000:0.0:1788875285.553515:0:14489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.553527:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.553554:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.553564:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.553572:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554289:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554298:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554304:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.554319:0:14489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788875285.554346:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554352:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554356:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554360:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a14e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.554363:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554371:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554380:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410c00) 00010000:00010000:0.0:1788875285.554383:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.554388:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554394:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14e00/0x60858e6020d83780 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875285.554407:0:14489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c43606c0 reply state 000000005bc5f83b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.554417:0:14489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788875285.554457:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a14c00/0x60858e6020d83779 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 14 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554486:0:14489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 13 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.554492:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875285.554494:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788875285.554495:0:14489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee0400, rc 0) 00000100:00100000:0.0:1788875285.554552:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14462:x1875771218055680:12345-192.168.202.7@tcp:101:bash.0 Request processed in 10038us (10272us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788875285.554558:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 28 00010000:00010000:0.0:1788875285.565085:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565106:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565113:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565119:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a04ee1400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.565124:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565131:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565149:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875285.565152:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875285.565156:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.565179:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d83787 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875285.576741:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.576880:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218055936 00000100:00100000:0.0:1788875285.576890:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218055936 00000100:00100000:0.0:1788875285.576966:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:0.0:1788875285.576985:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+13:14462:x1875771218055936:12345-192.168.202.7@tcp:101:bash.0 00010000:00010000:0.0:1788875285.577010:0:16362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.577031:0:16362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8379c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1014 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577135:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577153:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577166:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.577212:0:16362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788875285.577216:0:16362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875285.577232:0:16362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577244:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577269:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d8379c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 15 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577302:0:16362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 14 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.577310:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875285.577313:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875285.577316:0:16362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1a00, rc 0) 00000100:00100000:0.0:1788875285.577375:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14462:x1875771218055936:12345-192.168.202.7@tcp:101:bash.0 Request processed in 400us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.577382:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 29 00000100:00100000:1.0:1788875285.581611:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.581759:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218056192 00000100:00100000:0.0:1788875285.581807:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218056192 00000100:00100000:0.0:1788875285.582145:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:0.0:1788875285.582158:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14462:x1875771218056192:12345-192.168.202.7@tcp:35:bash.0 00000100:00100000:0.0:1788875285.582540:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+15:14462:x1875771218056192:12345-192.168.202.7@tcp:35:bash.0 Request processed in 384us (937us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788875285.582548:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000040:00080000:3.0:1788875285.648487:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788875285.651182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.660539:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218056448 00000100:00100000:2.0:1788875285.660555:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218056448 00000100:00100000:2.0:1788875285.660694:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:2.0:1788875285.660705:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+15:14472:x1875771218056448:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:2.0:1788875285.660731:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875285.660767:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d837aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a101b expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875285.662184:0:14490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788875285.662323:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d837aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a101b expref: 17 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.662340:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5a0bc0d000) 00010000:00010000:2.0:1788875285.662343:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788875285.662348:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d837aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a101b expref: 17 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.662364:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848a00, rc 0) 00000100:00100000:2.0:1788875285.662433:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+16:14472:x1875771218056448:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 1729us (11259us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788875285.662441:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:1.0:1788875285.675254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875285.676208:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218056704 00000100:00100000:3.0:1788875285.676219:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218056704 00000100:00100000:3.0:1788875285.676279:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1788875285.676291:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+16:14472:x1875771218056704:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:3.0:1788875285.676592:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14472:x1875771218056704:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 303us (1346us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788875285.676599:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:1.0:1788875285.740656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.740814:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218056960 00000100:00100000:0.0:1788875285.740826:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218056960 00000100:00100000:0.0:1788875285.740895:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:0.0:1788875285.740905:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14475:x1875771218056960:12345-192.168.202.7@tcp:101:lfs.0 00010000:00010000:0.0:1788875285.740929:0:16362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.740951:0:16362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d837b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1022 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.741072:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d837bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.741102:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d837bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.741117:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d837bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.741130:0:16362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788875285.741272:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1c00/0x60858e6020d837b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1022 expref: 20 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.741291:0:16362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d837bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1022 expref: 19 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.741300:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875285.741302:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875285.741306:0:16362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a04ee1400, rc 0) 00000100:00100000:0.0:1788875285.741363:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+19:14475:x1875771218056960:12345-192.168.202.7@tcp:101:lfs.0 Request processed in 460us (720us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788875285.741369:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:1.0:1788875285.745250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.745336:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218057088 00000100:00100000:0.0:1788875285.745349:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218057088 00000100:00100000:0.0:1788875285.745427:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1788875285.745438:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+19:14475:x1875771218057088:12345-192.168.202.7@tcp:54:lfs.0 00010000:00010000:0.0:1788875285.745529:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745551:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745585:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745617:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745624:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745632:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745638:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c44000 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875285.745643:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745651:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745663:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875285.745666:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788875285.745671:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.745678:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875285.745762:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+19:14475:x1875771218057088:12345-192.168.202.7@tcp:54:lfs.0 Request processed in 326us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875285.745770:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 32 00000100:00100000:0.0:1788875285.747349:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.747428:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218057216 00000100:00100000:2.0:1788875285.747436:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218057216 00000100:00100000:2.0:1788875285.747487:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1788875285.747518:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+19:2349:x1875771218057216:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875285.747533:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875285.747557:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1400/0x60858e6020d837bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1022 expref: 19 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.747578:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875285.747583:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875285.748243:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:2349:x1875771218057216:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 720us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875285.748252:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:3.0:1788875285.748523:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.748817:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218057472 00000100:00100000:2.0:1788875285.748824:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218057472 00000100:00100000:2.0:1788875285.748871:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1788875285.748880:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14475:x1875771218057472:12345-192.168.202.7@tcp:35:lfs.0 00000100:00100000:2.0:1788875285.749319:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+19:14475:x1875771218057472:12345-192.168.202.7@tcp:35:lfs.0 Request processed in 438us (794us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788875285.749328:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:3.0:1788875285.965573:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.965706:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218057728 00000100:00100000:0.0:1788875285.965717:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218057728 00000100:00100000:0.0:1788875285.965903:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1788875285.965915:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+19:14507:x1875771218057728:12345-192.168.202.7@tcp:101:cat.0 00010000:00010000:0.0:1788875285.965942:0:16362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875285.966292:0:16362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1029 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.966398:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44600/0x60858e6020d837db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.966414:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44600/0x60858e6020d837db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.966428:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44600/0x60858e6020d837db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875285.966440:0:16362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788875285.966592:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44000/0x60858e6020d837d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1029 expref: 22 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.966614:0:16362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44600/0x60858e6020d837db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1029 expref: 21 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875285.966623:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875285.966627:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875285.966630:0:16362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c44600, rc 0) 00000100:00100000:0.0:1788875285.966704:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+21:14507:x1875771218057728:12345-192.168.202.7@tcp:101:cat.0 Request processed in 792us (1142us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788875285.966724:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 33 00000100:00100000:0.0:1788875285.969934:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875285.969992:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875285.970143:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218058112 00000100:00100000:2.0:1788875285.970153:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218058112 00000100:00100000:2.0:1788875285.970219:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:2.0:1788875285.970230:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+21:2347:x1875771218058112:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875285.970247:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875285.970275:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44600/0x60858e6020d837db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1029 expref: 21 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875285.970296:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875285.970317:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875285.970377:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+20:2347:x1875771218058112:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 148us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875285.970384:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:1.0:1788875285.970766:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218057984 00000100:00100000:1.0:1788875285.970805:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218057984 00000100:00100000:1.0:1788875285.970847:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 8 00000100:00100000:1.0:1788875285.970856:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+20:14507:x1875771218057984:12345-192.168.202.7@tcp:35:cat.0 00000001:00080000:1.0:1788875285.971151:0:14492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934607 00000100:00100000:1.0:1788875285.971256:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+22:14507:x1875771218057984:12345-192.168.202.7@tcp:35:cat.0 Request processed in 401us (1332us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788875285.971264:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 8 00000020:00080000:1.0:1788875285.971268:0:14492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788875286.015138:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875286.015256:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218058368 00000100:00100000:3.0:1788875286.015266:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218058368 00000100:00100000:3.0:1788875286.015345:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:3.0:1788875286.015357:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+22:14513:x1875771218058368:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:3.0:1788875286.015381:0:14489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875286.015405:0:14489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15800/0x60858e6020d837e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1030 expref: -99 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015522:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015538:0:14489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015546:0:14489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 23 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015555:0:14489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015588:0:14489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 23 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.015602:0:14489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 23 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.015615:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113600:192.168.202.7@tcp:104: 00000100:00080000:0.0:1788875286.015739:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788875286.016026:0:14489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.016046:0:14489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.016053:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d279180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113728:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875286.016091:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788875286.021766:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.022023:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218058496 00000100:00100000:2.0:1788875286.022034:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218058496 00010000:00010000:2.0:1788875286.022090:0:14475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 24 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.022144:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875286.022155:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3626b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+24:2348:x1875771218058496:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875286.022173:0:14475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875286.022181:0:14475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 24 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.022196:0:14475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 24 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.022222:0:14475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875286.022228:0:14475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.022237:0:14475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.022244:0:14475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875286.022309:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3626b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+24:2348:x1875771218058496:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 156us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.022335:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:2.0:1788875286.027253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1788875286.027421:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee1a00/0x60858e6020d837a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1014 expref: 23 pid: 16362 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.027451:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113600:192.168.202.7@tcp:104: 00000100:00100000:3.0:1788875286.027471:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d279180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14489:1875771241113728:192.168.202.7@tcp:104: 00010000:00010000:3.0:1788875286.027508:0:14489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.029184:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218058624 00000100:00100000:0.0:1788875286.029199:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218058624 00010000:00010000:0.0:1788875286.029254:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.029370:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 12 00000100:00100000:0.0:1788875286.029383:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+23:2347:x1875771218058624:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875286.029404:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875286.029413:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029428:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029456:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a04ee0400/0x60858e6020d8378e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a100d expref: 23 pid: 14489 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029478:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875286.029485:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029506:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029535:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.029571:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875286.029647:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+22:2347:x1875771218058624:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 258us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.029655:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 12 00010000:00010000:3.0:1788875286.030154:0:14489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.030164:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788875286.030188:0:14489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788875286.030371:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15800/0x60858e6020d837e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1030 expref: 23 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.030389:0:14489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15a00/0x60858e6020d837f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1030 expref: 22 pid: 14489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.030411:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:3.0:1788875286.030414:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788875286.030417:0:14489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15a00, rc 0) 00000100:00100000:3.0:1788875286.030466:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+22:14513:x1875771218058368:12345-192.168.202.7@tcp:101:dd.0 Request processed in 15113us (15341us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1788875286.030475:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 34 00000100:00100000:3.0:1788875286.038004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.038217:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218058880 00000100:00100000:1.0:1788875286.038228:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218058880 00000100:00100000:1.0:1788875286.038298:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 35 00000100:00100000:1.0:1788875286.038309:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+22:14513:x1875771218058880:12345-192.168.202.7@tcp:36:dd.0 00010000:00010000:1.0:1788875286.038642:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.038660:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.038673:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788875286.038730:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:1.0:1788875286.038754:0:14488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d79c3ae reply state 00000000e26a0e4c transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875286.038763:0:14488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788875286.038902:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+25:14513:x1875771218058880:12345-192.168.202.7@tcp:36:dd.0 Request processed in 595us (918us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788875286.038913:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 35 00000020:00080000:1.0:1788875286.038920:0:14488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788875286.046406:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046429:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046437:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046443:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875286.046449:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046458:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046484:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:3.0:1788875286.046500:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875286.046507:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.046514:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18400/0x60858e6020d837fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.047901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.048275:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059008 00000100:00100000:2.0:1788875286.048288:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059008 00000100:00100000:2.0:1788875286.048356:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:2.0:1788875286.048366:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+24:14513:x1875771218059008:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:2.0:1788875286.048399:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875286.048423:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848600/0x60858e6020d83805 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1037 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.048497:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848600/0x60858e6020d83805 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1037 expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.048513:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848600/0x60858e6020d83805 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1037 expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.048534:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875286.048538:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875286.048541:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848600, rc 0) 00000100:00100000:2.0:1788875286.048608:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+25:14513:x1875771218059008:12345-192.168.202.7@tcp:101:dd.0 Request processed in 244us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.048616:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 36 00000100:00100000:1.0:1788875286.069337:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.070217:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059264 00000100:00100000:0.0:1788875286.070231:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059264 00000100:00100000:0.0:1788875286.070319:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:0.0:1788875286.070332:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+25:14513:x1875771218059264:12345-192.168.202.7@tcp:103:dd.0 00010000:00010000:0.0:1788875286.070350:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875286.070378:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848600/0x60858e6020d83805 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1037 expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.070399:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875286.070405:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875286.070469:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+24:14513:x1875771218059264:12345-192.168.202.7@tcp:103:dd.0 Request processed in 140us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.070476:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:2.0:1788875286.075492:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.075588:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059392 00000100:00100000:1.0:1788875286.075600:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059392 00000100:00100000:1.0:1788875286.075661:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:1.0:1788875286.075671:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+24:14513:x1875771218059392:12345-192.168.202.7@tcp:58:dd.0 00010000:00010000:1.0:1788875286.076181:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.076207:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.076225:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788875286.078755:0:14488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788875286.079246:0:14488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788875286.079318:0:14488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788875286.079506:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+24:14513:x1875771218059392:12345-192.168.202.7@tcp:58:dd.0 Request processed in 3831us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875286.079518:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 37 00000100:00100000:0.0:1788875286.088506:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.092736:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059520 00000100:00100000:2.0:1788875286.092862:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059520 00000100:00100000:2.0:1788875286.092951:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 38 00000100:00100000:2.0:1788875286.092965:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+24:14513:x1875771218059520:12345-192.168.202.7@tcp:101:dd.0 00010000:00010000:2.0:1788875286.093006:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875286.093030:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a103e expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093256:0:14490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093269:0:14490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093290:0:14490:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093304:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093319:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875286.093323:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875286.093327:0:14490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 25 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.093335:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848800, rc 0) 00000100:00100000:2.0:1788875286.093520:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+25:14513:x1875771218059520:12345-192.168.202.7@tcp:101:dd.0 Request processed in 557us (5026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.093528:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 38 00010000:00010000:3.0:1788875286.158042:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788875286.408415:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:2.0:1788875286.408440:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788875286.408524:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1788875286.408901:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1788875286.670713:0:14520:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788875286.670724:0:14520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788875286.670794:0:14520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788875286.670803:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788875286.670928:0:14520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3d27bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14520:1875771241113856:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788875286.671040:0:14520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875286.678319:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.678533:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059648 00000100:00100000:1.0:1788875286.678545:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059648 00000100:00100000:3.0:1788875286.678807:0:14520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3d27bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14520:1875771241113856:192.168.202.7@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788875286.683634:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1788875286.683664:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059648:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788875286.683828:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059648:12345-192.168.202.7@tcp:900:lhsmtool_posix.0 Request processed in 179us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875286.683853:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1788875286.694134:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875286.694228:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059776 00000100:00100000:3.0:1788875286.694241:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059776 00000100:00100000:3.0:1788875286.694339:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:3.0:1788875286.694356:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059776:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788875286.694392:0:16362:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788875286.694514:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059776:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 165us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875286.694523:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 39 00000100:00100000:3.0:1788875286.704356:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.707986:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218059904 00000100:00100000:0.0:1788875286.708002:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218059904 00000100:00100000:0.0:1788875286.708089:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1788875286.708101:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059904:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788875286.708448:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708466:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708478:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708544:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708552:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708560:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708582:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708589:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708595:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788875286.708632:0:14489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788875286.708636:0:14489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788875286.708648:0:14489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708659:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708671:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708678:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708683:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45c00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875286.708687:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708694:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708706:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:0.0:1788875286.708709:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875286.708713:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708719:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45c00/0x60858e6020d8381a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708745:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.708751:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709380:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709393:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875286.709403:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709410:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709421:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875286.709425:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875286.709428:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709434:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83821 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709455:0:14489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709461:0:14489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709467:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709472:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c44800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:0.0:1788875286.709475:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709481:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709488:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:0.0:1788875286.709490:0:14489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788875286.709499:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.709504:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d83828 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.709601:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218059904:12345-192.168.202.7@tcp:34:lhsmtool_posix.0 Request processed in 1501us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.709610:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 40 00000100:00100000:0.0:1788875286.712252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.712454:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218060160 00000100:00100000:1.0:1788875286.712467:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218060160 00000100:00100000:1.0:1788875286.712530:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:1.0:1788875286.712540:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+11:14514:x1875771218060160:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875286.712560:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875286.712578:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18e00/0x60858e6020d8382f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1045 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712669:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712685:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712696:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788875286.712709:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788875286.712908:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712917:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712925:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712931:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875286.712945:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712953:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712967:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:1.0:1788875286.712970:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788875286.712975:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.712982:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18800/0x60858e6020d83836 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.713035:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18e00/0x60858e6020d8382f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1045 expref: 13 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.713046:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5a0bc0d700) 00010000:00010000:1.0:1788875286.713059:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788875286.713063:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18e00/0x60858e6020d8382f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1045 expref: 13 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.713072:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a18e00, rc 0) 00000100:00100000:1.0:1788875286.713154:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+12:14514:x1875771218060160:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 615us (912us total) trans 8589934612 rc 301/301 00000100:00100000:1.0:1788875286.713163:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 41 00000100:00100000:1.0:1788875286.718642:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.718749:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218060288 00000100:00100000:2.0:1788875286.718806:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218060288 00000100:00100000:2.0:1788875286.718871:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1788875286.718882:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+12:14514:x1875771218060288:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788875286.718929:0:14490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788875286.719075:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+12:14514:x1875771218060288:12345-192.168.202.7@tcp:53:lhsmtool_posix.0 Request processed in 195us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.719084:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 42 00000100:00100000:2.0:1788875286.723384:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.723490:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218060544 00000100:00100000:1.0:1788875286.723500:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218060544 00000100:00100000:1.0:1788875286.723559:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:1.0:1788875286.723581:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+12:14514:x1875771218060544:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875286.723600:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875286.723619:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18e00/0x60858e6020d83844 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a104c expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788875286.724715:0:14488:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788875286.724724:0:14488:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788875286.725149:0:14488:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788875286.730952:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d8384b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.730980:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d8384b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.730995:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d8384b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.731113:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a18e00/0x60858e6020d83844 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a104c expref: 15 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.731139:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d8384b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a104c expref: 14 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.731148:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a0bc0d900) 00010000:00010000:0.0:1788875286.731151:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788875286.731155:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c44800, rc 0) 00000100:00100000:0.0:1788875286.731488:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218060544:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 7907us (8113us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788875286.731515:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 43 00000100:00100000:3.0:1788875286.750117:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.750583:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218060800 00000100:00100000:2.0:1788875286.750597:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218060800 00000100:00100000:2.0:1788875286.750663:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:2.0:1788875286.750674:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218060800:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788875286.750750:0:14490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875286.751081:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c44800/0x60858e6020d8384b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a104c expref: 14 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751102:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a0bc0d900) 00010000:00010000:2.0:1788875286.751115:0:14490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788875286.751139:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751152:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751162:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751390:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751398:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751404:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751637:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751646:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751653:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751658:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849400 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875286.751663:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751670:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751679:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5a08410c00) 00010000:00010000:2.0:1788875286.751681:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875286.751685:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751692:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d83859 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751710:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751716:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751721:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751727:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848200 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875286.751742:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.751750:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.752033:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x8d945f76 (ffff9e5a08410e00) 00010000:00010000:2.0:1788875286.752037:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875286.752041:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.752056:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d83860 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d945f76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.752156:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+13:14514:x1875771218060800:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 1481us (2047us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788875286.752165:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 44 00000100:00100000:1.0:1788875286.758148:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875286.758328:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218060928 00000100:00100000:3.0:1788875286.758341:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218060928 00000100:00100000:3.0:1788875286.758412:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1788875286.758422:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+13:14514:x1875771218060928:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788875286.758444:0:16362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788875286.758470:0:16362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15800/0x60858e6020d83867 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1053 expref: -99 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758527:0:16362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8386e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758541:0:16362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8386e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758554:0:16362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8386e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758648:0:16362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15800/0x60858e6020d83867 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1053 expref: 15 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758670:0:16362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a13a15600/0x60858e6020d8386e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1053 expref: 14 pid: 16362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.758679:0:16362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:3.0:1788875286.758683:0:16362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788875286.758687:0:16362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a13a15600, rc 0) 00000100:00100000:3.0:1788875286.759025:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218060928:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 603us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875286.759033:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 45 00000100:00100000:3.0:1788875286.772366:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.772577:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218061184 00000100:00100000:0.0:1788875286.772589:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218061184 00000100:00100000:0.0:1788875286.772651:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 46 00000100:00100000:0.0:1788875286.772662:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218061184:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875286.772765:0:14489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.772824:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.772846:0:14489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788875286.773471:0:14489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788875286.773482:0:14489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501638709125ns, next at 502638706760ns, rc = 0 00000004:00010000:0.0:1788875286.773566:0:14489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006505f6fc reply state 00000000612992eb transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.773574:0:14489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875286.773660:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+16:14514:x1875771218061184:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 999us (1302us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788875286.773668:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 46 00010000:00010000:1.0:1788875286.776818:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776846:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776853:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776860:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:1.0:1788875286.776865:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776873:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776891:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:1.0:1788875286.776894:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788875286.776899:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.776906:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83875 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.777213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.777322:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218061312 00000100:00100000:2.0:1788875286.777340:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218061312 00000100:00100000:2.0:1788875286.777391:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1788875286.777406:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+15:14514:x1875771218061312:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875286.777434:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875286.777454:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a105a expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.777513:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.777527:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.777544:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:2.0:1788875286.777547:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788875286.777550:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907848200, rc 0) 00000100:00100000:2.0:1788875286.777602:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+16:14514:x1875771218061312:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 198us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.777610:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 47 00000100:00100000:2.0:1788875286.784163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.784280:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218061440 00000100:00100000:0.0:1788875286.784290:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218061440 00000100:00100000:0.0:1788875286.784362:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875286.784374:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218061440:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788875286.784718:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2347:x1875771218061440:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 346us (565us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788875286.784738:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00080000:3.0:1788875286.785312:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788875286.790419:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.790551:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218061696 00000100:00100000:0.0:1788875286.790577:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218061696 00000100:00100000:0.0:1788875286.790646:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:0.0:1788875286.790657:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+16:14514:x1875771218061696:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788875286.790949:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14514:x1875771218061696:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 293us (540us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788875286.790957:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 9 00000100:00100000:2.0:1788875286.794713:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.794875:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218061952 00000100:00100000:0.0:1788875286.794886:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218061952 00000100:00100000:0.0:1788875286.794953:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:0.0:1788875286.794964:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14514:x1875771218061952:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788875286.795111:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3cd88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14514:x1875771218061952:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 148us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.795119:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 48 00000100:00100000:3.0:1788875286.797461:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.799313:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062080 00000100:00100000:2.0:1788875286.799329:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062080 00000100:00100000:2.0:1788875286.799408:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:2.0:1788875286.799419:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+17:14514:x1875771218062080:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788875286.799440:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788875286.799461:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848c00/0x60858e6020d83883 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1061 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799560:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799573:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799584:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788875286.799621:0:14488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788875286.799646:0:14488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799678:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848c00/0x60858e6020d83883 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1061 expref: 19 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799698:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1061 expref: 18 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.799708:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:2.0:1788875286.799711:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788875286.799715:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5907849400, rc 0) 00000100:00100000:2.0:1788875286.800067:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218062080:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 649us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.800074:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 49 00000100:00100000:1.0:1788875286.812542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.812622:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062208 00000100:00100000:0.0:1788875286.812635:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062208 00000100:00100000:0.0:1788875286.812694:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:0.0:1788875286.812705:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2347:x1875771218062208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788875286.812722:0:15170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788875286.812743:0:15170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a1068 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788875286.812803:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa01217, blocks: 0x1 00010000:00010000:0.0:1788875286.812825:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1788875286.812843:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875286.812853:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 7 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.812876:0:15170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 7 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.812890:0:15170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35c45c00, rc 0) 00000100:00100000:0.0:1788875286.812969:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2347:x1875771218062208:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 266us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.812976:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:3.0:1788875286.820719:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.827925:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062464 00000100:00100000:0.0:1788875286.827942:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062464 00000100:00100000:0.0:1788875286.828110:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:0.0:1788875286.828124:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218062464:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788875286.828335:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218062464:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 213us (7626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.828343:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 50 00000100:00100000:3.0:1788875286.838523:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.838656:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062592 00000100:00100000:0.0:1788875286.838665:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062592 00000100:00100000:0.0:1788875286.838730:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:0.0:1788875286.838741:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218062592:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788875286.898125:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:2.0:1788875286.898148:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788875286.898378:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788875286.898402:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241113984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788875286.898488:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875286.898540:0:16716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241113984 00000100:00100000:2.0:1788875286.898562:0:16716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241113984 00000100:00100000:2.0:1788875286.898636:0:16716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788875286.898647:0:16716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241113984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788875286.898827:0:16716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788875286.898831:0:16716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788875286.898834:0:16716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788875286.898836:0:16716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788875287 -> 1788875287 00002000:00010000:2.0:1788875286.898838:0:16716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788875286.898888:0:16716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241113984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (409us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788875286.898896:0:16716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788875286.898975:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788875286.899115:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5a048d5f80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788875286.899129:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241113984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788875286.899168:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218062592:12345-192.168.202.7@tcp:44:lhsmtool_posix.0 Request processed in 60427us (60653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.899178:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 51 00000100:00100000:1.0:1788875286.902365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.902673:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062720 00000100:00100000:2.0:1788875286.902684:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062720 00000100:00100000:2.0:1788875286.902736:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1788875286.902746:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2348:x1875771218062720:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788875286.903156:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2348:x1875771218062720:12345-192.168.202.7@tcp:16:lhsmtool_posix.0 Request processed in 409us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875286.903165:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:2.0:1788875286.907395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.907466:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218062976 00000100:00100000:0.0:1788875286.907478:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218062976 00000100:00100000:0.0:1788875286.907706:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:0.0:1788875286.907717:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218062976:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788875286.907823:0:14490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875286.907856:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849400/0x60858e6020d8388a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1061 expref: 14 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.907876:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:0.0:1788875286.907881:0:14490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788875286.907911:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.907925:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.907935:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788875286.908150:0:14490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069c8bdf7 reply state 00000000ffdd23e1 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.908160:0:14490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788875286.908258:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+15:14514:x1875771218062976:12345-192.168.202.7@tcp:36:lhsmtool_posix.0 Request processed in 542us (872us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788875286.908265:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 52 00000100:00100000:2.0:1788875286.912138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:3.0:1788875286.912208:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912220:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912228:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912234:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45800 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875286.912239:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912247:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912262:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:3.0:1788875286.912265:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788875286.912269:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.912275:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35c45800/0x60858e6020d83898 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875286.912344:0:16716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063104 00000100:00100000:1.0:1788875286.912354:0:16716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063104 00000100:00100000:1.0:1788875286.912402:0:16716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1788875286.912412:0:16716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+7:14514:x1875771218063104:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788875286.912428:0:16716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788875286.912444:0:16716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf9b88d412e6a106f expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.912473:0:16716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.912482:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875286.912487:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875286.912493:0:16716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.912526:0:16716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.912560:0:16716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875286.912587:0:16716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16716:1875771241114112:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875286.912681:0:16716:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a056d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788875286.917860:0:16716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16716:1875771241114112:192.168.202.7@tcp:104: 00010000:00010000:2.0:1788875286.917913:0:16716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.917936:0:16716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5a35a19400, rc 0) 00000100:00100000:2.0:1788875286.917995:0:16716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+8:14514:x1875771218063104:12345-192.168.202.7@tcp:101:lhsmtool_posix.0 Request processed in 5583us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.918005:0:16716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:1.0:1788875286.918335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.919277:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063232 00000100:00100000:0.0:1788875286.919288:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063232 00010000:00010000:0.0:1788875286.919333:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.919522:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:0.0:1788875286.919534:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+8:2347:x1875771218063232:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788875286.919553:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788875286.919576:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.919590:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.919611:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d83891 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a1068 expref: 8 pid: 15170 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.919628:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875286.919632:0:14474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875286.919640:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 7 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.919650:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 7 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.919688:0:14474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 7 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.919716:0:14474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14474:1875771241114240:192.168.202.7@tcp:105: 00000100:00100000:0.0:1788875286.919832:0:14474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a056c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875286.923647:0:14474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14474:1875771241114240:192.168.202.7@tcp:105: 00010000:00010000:0.0:1788875286.923673:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788875286.923729:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2347:x1875771218063232:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 4196us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.923739:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 13 00000100:00100000:3.0:1788875286.925441:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875286.925505:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063360 00000100:00100000:1.0:1788875286.925516:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063360 00000100:00100000:1.0:1788875286.925574:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:1.0:1788875286.925585:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2347:x1875771218063360:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788875286.926399:0:15171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788875286.926405:0:15171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788875286 00002000:00010000:1.0:1788875286.926408:0:15171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788875285 00002000:00010000:1.0:1788875286.926409:0:15171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788875287 -> 1788875286 00002000:00010000:1.0:1788875286.926411:0:15171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788875286.926474:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+8:2347:x1875771218063360:12345-192.168.202.7@tcp:2:lhsmtool_posix.0 Request processed in 888us (1039us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788875286.926484:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:1.0:1788875286.930946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.932302:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063488 00000100:00100000:0.0:1788875286.932315:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063488 00000100:00100000:0.0:1788875286.932387:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1788875286.932397:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+8:2350:x1875771218063488:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788875286.932440:0:15172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.932460:0:15172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.932469:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788875286.932474:0:15172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788875286.932479:0:15172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.932513:0:15172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.932547:0:15172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.932563:0:15172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15172:1875771241114368:192.168.202.7@tcp:104: 00000100:00100000:0.0:1788875286.932652:0:15172:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a056c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788875286.937159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.937919:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063616 00000100:00100000:2.0:1788875286.937941:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063616 00010000:00010000:2.0:1788875286.937975:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 9 pid: 16716 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.938064:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 14 00000100:00100000:2.0:1788875286.938074:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+9:2348:x1875771218063616:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788875286.938089:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875286.938113:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 9 pid: 16716 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.938128:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 9 pid: 16716 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.938155:0:14473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875286.938160:0:14473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788875286.938166:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.938176:0:14473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.938198:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788875286.938320:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+9:2348:x1875771218063616:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 247us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.938326:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 14 00010000:00010000:0.0:1788875286.939502:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4d73a2/0x60858e6020d8389f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a106f expref: 8 pid: 16716 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.939523:0:15172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a35971500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15172:1875771241114368:192.168.202.7@tcp:104: 00010000:00010000:0.0:1788875286.939547:0:15172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939558:0:15172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939565:0:15172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939597:0:15172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939606:0:15172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939633:0:15172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939640:0:15172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35c45c00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:0.0:1788875286.939644:0:15172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939653:0:15172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939668:0:15172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788875286.939676:0:15172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000965782ba/0x60858e6020d838a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875286.939767:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2350:x1875771218063488:12345-192.168.202.7@tcp:1:lhsmtool_posix.0 Request processed in 7370us (8830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.939836:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:3.0:1788875286.941496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875286.941609:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218063872 00000100:00100000:2.0:1788875286.941618:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218063872 00000100:00100000:2.0:1788875286.941692:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 53 00000100:00100000:2.0:1788875286.941704:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+14:14514:x1875771218063872:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788875286.941818:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.941834:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.941845:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.942091:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.942103:0:14488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 15 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.942110:0:14488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.942144:0:14488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 15 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.942157:0:14488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 15 pid: 14488 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.942171:0:14488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14488:1875771241114496:192.168.202.7@tcp:104: 00000100:00100000:2.0:1788875286.942255:0:14488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5904faf300 going to sleep for 11 seconds 00000100:00100000:3.0:1788875286.946679:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.946885:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064000 00000100:00100000:0.0:1788875286.946896:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064000 00010000:00010000:1.0:1788875286.947098:0:14474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.947190:0:14488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14488:1875771241114496:192.168.202.7@tcp:104: 00000100:00100000:1.0:1788875286.947196:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 15 00000100:00100000:1.0:1788875286.947211:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+16:2347:x1875771218064000:12345-192.168.202.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788875286.947238:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788875286.947243:0:14488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947247:0:14474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947269:0:14474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947292:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848200/0x60858e6020d8387c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a105a expref: 16 pid: 14488 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947309:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:1.0:1788875286.947314:0:14474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947321:0:14474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947327:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.947357:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788875286.947403:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+15:2347:x1875771218064000:12345-192.168.202.7@tcp:103:ldlm_bl.0 Request processed in 198us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875286.947408:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 15 00010000:00010000:2.0:1788875286.947456:0:14488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.947462:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875286.947655:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788875286.947805:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:2.0:1788875286.947855:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788875286.947937:0:14488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14488:1875771241114624:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788875286.948041:0:14488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875286.948083:0:14488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5904faf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788875286.948126:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241114624 00000100:00100000:0.0:1788875286.948131:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241114624 00000100:00100000:0.0:1788875286.948185:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788875286.948194:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14488:x1875771241114624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788875286.948281:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14488:x1875771241114624:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875286.948288:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788875286.948417:0:14488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14488:1875771241114624:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788875286.949385:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1788875286.949485:0:14488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14488:1875771241114752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788875286.949548:0:14488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788875286.949581:0:14488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5904faf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788875286.949619:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241114752 00000100:00100000:2.0:1788875286.949626:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241114752 00000100:00100000:2.0:1788875286.949672:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788875286.949682:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14488:x1875771241114752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788875286.950287:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14488:x1875771241114752:12345-0@lo:1000:mdt00_000.0 Request processed in 606us (740us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788875286.950296:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788875286.950406:0:14488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a355e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14488:1875771241114752:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788875286.950447:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950458:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950466:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950474:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875286.950479:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950487:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950505:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:3.0:1788875286.950508:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875286.950514:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950521:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848a00/0x60858e6020d838b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950550:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950557:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950573:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950578:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:3.0:1788875286.950580:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950586:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950594:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:3.0:1788875286.950597:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788875286.950604:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950615:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950623:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875286.950652:0:14488:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848800/0x60858e6020d83813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.7@tcp remote: 0xf9b88d412e6a103e expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875286.950664:0:14488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14488:1875771241114880:192.168.202.7@tcp:105: 00000100:00100000:3.0:1788875286.951457:0:14488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5a04e1f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788875286.955407:0:14488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3fd49500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14488:1875771241114880:192.168.202.7@tcp:105: 00010000:00010000:2.0:1788875286.955460:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955473:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19a00/0x60858e6020d8380c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955511:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955526:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955538:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955551:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955557:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955564:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955571:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848e00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875286.955575:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955583:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955594:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875286.955598:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788875286.955610:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955616:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907848e00/0x60858e6020d838bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955628:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955635:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955641:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955647:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849a00 already unused, calling callback (ffffffffc217f4f0) 00010000:00010000:2.0:1788875286.955650:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955656:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955665:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e5a0bc0da00) 00010000:00010000:2.0:1788875286.955668:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788875286.955671:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.955678:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5907849a00/0x60858e6020d838ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875286.955993:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218063872:12345-192.168.202.7@tcp:57:lhsmtool_posix.0 Request processed in 14290us (14502us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788875286.956005:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 53 00000020:00080000:2.0:1788875286.956018:0:14488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788875286.956096:0:14520:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788875286.956104:0:14520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788875286.956105:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000040:00080000:3.0:1788875286.956152:0:14520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788875286.956159:0:14520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788875286.956229:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064128 00000100:00100000:2.0:1788875286.956235:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064128 00000100:00100000:2.0:1788875286.956279:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875286.956290:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a34efe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14513:x1875771218064128:12345-192.168.202.7@tcp:49:dd.0 00000100:00100000:2.0:1788875286.956392:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a34efe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14513:x1875771218064128:12345-192.168.202.7@tcp:49:dd.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875286.956398:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 10 00000100:00100000:2.0:1788875286.960902:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875286.960988:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064384 00000100:00100000:0.0:1788875286.961001:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064384 00000100:00100000:0.0:1788875286.961076:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 11 00000100:00100000:0.0:1788875286.961091:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+18:14514:x1875771218064384:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788875286.963017:0:14492:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788875286.963174:0:14492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:1.0:1788875286.963255:0:14492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963285:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963297:0:14492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963307:0:14492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963315:0:14492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963323:0:14492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875286.963351:0:14492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788875286.963543:0:14477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788875286.963551:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.963559:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19600 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875286.963564:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.963572:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.963588:0:14477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e5a10903200) 00010000:00010000:2.0:1788875286.963592:0:14477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788875286.963598:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875286.963604:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5a35a19600/0x60858e6020d838c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875286.963607:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+20:14514:x1875771218064384:12345-192.168.202.7@tcp:35:lhsmtool_posix.0 Request processed in 2514us (2710us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788875286.963624:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 11 00010000:00010000:2.0:1788875286.963631:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788875286.963631:0:14492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788875286.963641:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788875286.963643:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875287.156284:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875287.156331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875287.156359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:1.0:1788875287.156513:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064768 00000100:00100000:1.0:1788875287.156523:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064768 00000100:00100000:1.0:1788875287.156572:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064640 00000100:00100000:1.0:1788875287.156574:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064640 00000100:00100000:1.0:1788875287.156582:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064512 00000100:00100000:1.0:1788875287.156584:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064512 00000100:00100000:1.0:1788875287.156594:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:1.0:1788875287.156601:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+9:2347:x1875771218064768:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:1.0:1788875287.156640:0:15177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa01216, atime: 0x6aa01215, ctime: 0x6aa01216, blocks: 0x1 00010000:00010000:1.0:1788875287.156660:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875287.156674:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1788875287.156677:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875287.156682:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875287.156693:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.182284:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788875287.264498:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:2.0:1788875287.264541:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1788875287.264567:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1788875287.264644:0:15177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788875287.264649:0:15177:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788875286 -> 1788875287 00002000:00010000:2.0:1788875287.264653:0:15177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788875287.264672:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.264689:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.264700:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.264709:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a18200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875287.264716:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.265084:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.265113:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.265123:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d10e64/0x60858e6020d838c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875287.265275:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+7:2347:x1875771218064768:12345-192.168.202.7@tcp:4:dd.0 Request processed in 108664us (108993us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788875287.265294:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 0 00000100:00100000:2.0:1788875287.265341:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:2.0:1788875287.265358:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2349:x1875771218064640:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:2.0:1788875287.265414:0:15177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa01217, atime: 0x6aa01215, ctime: 0x0, blocks: 0x807 00010000:00010000:2.0:1788875287.265421:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.265436:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1788875287.265442:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.265451:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.265468:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788875287.382716:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241115008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788875287.382830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788875287.382917:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115008 00000100:00100000:0.0:1788875287.382925:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115008 00000100:00100000:0.0:1788875287.382983:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788875287.382991:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241115008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788875287.383020:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788875287.383071:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875771241115008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875287.383078:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788875287.383102:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788875287.383146:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875771241115008:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788875287.395162:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1788875287.395295:0:15177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788875287.395302:0:15177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788875287.395322:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395339:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395376:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395384:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875287.395390:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395401:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395427:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.395436:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875287.395569:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+6:2349:x1875771218064640:12345-192.168.202.7@tcp:4:dd.0 Request processed in 130211us (239237us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788875287.395579:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 1 00000100:00100000:2.0:1788875287.395631:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:2.0:1788875287.395648:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218064512:12345-192.168.202.7@tcp:4:dd.0 00002000:00010000:2.0:1788875287.395701:0:15177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa01217, atime: 0x6aa01215, ctime: 0x0, blocks: 0x1007 00010000:00010000:2.0:1788875287.395709:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.396402:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1788875287.396408:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.396415:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.396432:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.416596:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:3.0:1788875287.416749:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875287.418507:0:15178:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788875287.419570:0:15176:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788875287.420190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:2.0:1788875287.420376:0:15178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788875287.420918:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218064896 00000100:00100000:0.0:1788875287.420933:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218064896 00000100:00100000:0.0:1788875287.421010:0:15178:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788875287.421022:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065024 00000100:00100000:0.0:1788875287.421026:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065024 00000100:00100000:2.0:1788875287.421907:0:16718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065280 00000100:00100000:2.0:1788875287.421921:0:16718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065280 00000100:00100000:2.0:1788875287.422011:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1788875287.422026:0:15176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+9:2348:x1875771218064896:12345-192.168.202.7@tcp:4:dd.0 00000100:00100000:3.0:1788875287.422039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1788875287.422089:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.422094:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00010000:00010000:2.0:1788875287.422112:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.422117:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.422125:0:15176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.422145:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788875287.422152:0:15178:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788875287.422162:0:15178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788875287.429609:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065152 00000100:00100000:3.0:1788875287.429627:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065152 00000100:00100000:3.0:1788875287.429727:0:15178:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788875287.429740:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065408 00000100:00100000:3.0:1788875287.429744:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065408 00000100:00100000:1.0:1788875287.431195:0:16719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:1.0:1788875287.431214:0:16719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5c03ea99-fe93-4040-b0ab-19354d12a812+14:2347:x1875771218065024:12345-192.168.202.7@tcp:4:dd.0 00010000:00010000:1.0:1788875287.431266:0:16719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875287.431289:0:16719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875287.431294:0:16719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788875287.431301:0:16719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788875287.431319:0:16719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875287.525981:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788875287.527149:0:15177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1788875287.527161:0:15177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788875287.527181:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527197:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527207:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527216:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907849a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875287.527222:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527234:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527284:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527293:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f65908/0x60858e6020d838d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.527422:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a35972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+16:2349:x1875771218064512:12345-192.168.202.7@tcp:4:dd.0 Request processed in 131776us (371056us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788875287.527436:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 2 00000100:00100000:3.0:1788875287.527493:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 5 00000100:00100000:3.0:1788875287.527506:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+15:2347:x1875771218065280:12345-192.168.202.7@tcp:4:dd.0 00010000:00010000:3.0:1788875287.527542:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527556:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875287.527562:0:15177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875287.527571:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.527589:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788875287.604487:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1788875287.604563:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1788875287.604617:0:16719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:3.0:1788875287.604649:0:16719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1788875287.604689:0:16719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.604703:0:16719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.604713:0:16719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.604714:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.604723:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.604731:0:16719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a35a19000 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875287.604731:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.604737:0:16719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.604738:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848e00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875287.604742:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.604749:0:16719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.604749:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.607565:0:16719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.607599:0:16719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3df2139/0x60858e6020d838e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.611151:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.611178:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bebe038e/0x60858e6020d838de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.613902:0:16719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3d3db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5c03ea99-fe93-4040-b0ab-19354d12a812+12:2347:x1875771218065024:12345-192.168.202.7@tcp:4:dd.0 Request processed in 182671us (197129us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788875287.613924:0:16719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 4 00000100:00100000:3.0:1788875287.613979:0:16719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 6 00000100:00100000:3.0:1788875287.613998:0:16719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5c03ea99-fe93-4040-b0ab-19354d12a812+11:2348:x1875771218065152:12345-192.168.202.7@tcp:4:dd.0 00010000:00010000:3.0:1788875287.614084:0:16719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.614108:0:16719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875287.614113:0:16719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788875287.614120:0:16719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.614137:0:16719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875287.615902:0:15176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3fd49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+11:2348:x1875771218064896:12345-192.168.202.7@tcp:4:dd.0 Request processed in 193859us (199303us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788875287.615921:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 3 00000100:00100000:2.0:1788875287.616393:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:2.0:1788875287.616432:0:15176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+10:2347:x1875771218065408:12345-192.168.202.7@tcp:4:dd.0 00010000:00010000:2.0:1788875287.616492:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.616517:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.616521:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788875287.616531:0:15176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.616549:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788875287.678924:0:15177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788875287.678940:0:15177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788875287.678973:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.678989:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.678999:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.679007:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15800 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875287.679012:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.679023:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.679254:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.679266:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b593c2/0x60858e6020d838ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.679430:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c03ea99-fe93-4040-b0ab-19354d12a812+15:2347:x1875771218065280:12345-192.168.202.7@tcp:4:dd.0 Request processed in 151918us (259240us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788875287.679442:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 5 00000001:00080000:3.0:1788875287.679500:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1788875287.760861:0:16719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1788875287.760893:0:16719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.760913:0:16719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.760926:0:16719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.760934:0:16719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5a13a15200 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:3.0:1788875287.760942:0:16719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.760954:0:16719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.761015:0:16719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788875287.761025:0:16719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043df6132/0x60858e6020d838f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788875287.761180:0:16719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5c03ea99-fe93-4040-b0ab-19354d12a812+11:2348:x1875771218065152:12345-192.168.202.7@tcp:4:dd.0 Request processed in 147182us (339144us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788875287.761193:0:16719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 6 00000001:00080000:3.0:1788875287.761271:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1788875287.761291:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1788875287.764352:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764380:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764390:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764398:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5907848a00 already unused, calling callback (ffffffffc17704f0) 00010000:00010000:2.0:1788875287.764404:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764416:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764484:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788875287.764494:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c17c69/0x60858e6020d838fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788875287.764654:0:15176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2347:x1875771218065408:12345-192.168.202.7@tcp:4:dd.0 Request processed in 148226us (342557us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788875287.764667:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 7 00000100:00100000:1.0:1788875287.886514:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23009a34-c6dd-4af5-b962-084fb475da02:3306:1875771241115136:0@lo:400:kworker.0 00000100:00100000:0.0:1788875287.886574:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241115392:0@lo:400:kworker.0 00000100:00100000:2.0:1788875287.886651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241115520:0@lo:400:kworker.0 00000100:00100000:3.0:1788875287.886684:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241115264:0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.890895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875287.893099:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241115648:0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.893201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875287.893999:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115136 00000100:00100000:1.0:1788875287.894011:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115136 00000100:00100000:1.0:1788875287.894089:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788875287.894101:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:3306:x1875771241115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.894184:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23009a34-c6dd-4af5-b962-084fb475da02+19:3306:x1875771241115136:12345-0@lo:400:kworker.0 Request processed in 85us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875287.894192:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788875287.894264:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23009a34-c6dd-4af5-b962-084fb475da02:3306:1875771241115136:0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.894312:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115648 00000100:00100000:1.0:1788875287.894317:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115648 00000100:00100000:1.0:1788875287.894360:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788875287.894367:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a048d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.894426:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a048d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875771241115648:12345-0@lo:400:kworker.0 Request processed in 59us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875287.894433:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788875287.894466:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875771241115648:0@lo:400:kworker.0 00000100:00080000:1.0:1788875287.894497:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788875287.897678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875287.898871:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115392 00000100:00100000:1.0:1788875287.898890:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115392 00000100:00100000:1.0:1788875287.898981:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788875287.898994:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241115392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.899109:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875771241115392:12345-0@lo:400:kworker.0 Request processed in 117us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875287.899119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788875287.899136:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788875287.899158:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115520 00000100:00100000:1.0:1788875287.899162:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115520 00000100:00100000:1.0:1788875287.899197:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788875287.899204:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241115520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788875287.899240:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a355e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875771241115520:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788875287.899246:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788875287.899272:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788875287.899360:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875771241115520:0@lo:400:kworker.0 00000100:00100000:0.0:1788875287.899702:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a3628b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875771241115392:0@lo:400:kworker.0 00000100:00100000:3.0:1788875287.899884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875287.899937:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241115776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788875287.899980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788875287.900051:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115776 00000100:00100000:3.0:1788875287.900058:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115776 00000100:00100000:2.0:1788875287.900076:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771241115264 00000100:00100000:2.0:1788875287.900083:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771241115264 00000100:00100000:2.0:1788875287.900128:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788875287.900137:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241115264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788875287.900186:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875771241115264:12345-0@lo:400:kworker.0 Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788875287.900193:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788875287.900229:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788875287.900235:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5a048d5f80, transno 8589934595 00000004:00080000:2.0:1788875287.900882:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788875287.900917:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a36289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241115264:0@lo:400:kworker.0 00000100:00100000:3.0:1788875287.901108:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788875287.901124:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a362b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241115776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788875287.901151:0:15174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 64684032 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1788875287.901226:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a362b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875771241115776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875287.901234:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788875287.901366:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5a048d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875771241115776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788875288.209302:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788875289.230154:0:14476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788875289.374143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374189:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374294:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.7@tcp (source: 12345-192.168.202.7@tcp) 00000100:00100000:0.0:1788875289.374429:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218066048 00000100:00100000:0.0:1788875289.374442:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218066048 00000100:00100000:0.0:1788875289.374526:0:16362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065664 00000100:00100000:0.0:1788875289.374530:0:16362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065664 00000100:00100000:0.0:1788875289.374561:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:0.0:1788875289.374573:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2350:x1875771218066048:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.374668:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d842d8e5-7831-40d7-899a-0f57c20fe6b7+6:2350:x1875771218066048:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.374677:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 30 00000100:00100000:0.0:1788875289.374698:0:16362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:0.0:1788875289.374705:0:16362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+20:2349:x1875771218065664:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.374734:0:16362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c03ea99-fe93-4040-b0ab-19354d12a812+20:2349:x1875771218065664:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.374740:0:16362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 31 00000100:00100000:0.0:1788875289.374811:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065792 00000100:00100000:0.0:1788875289.374815:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065792 00000100:00100000:0.0:1788875289.374836:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218066304 00000100:00100000:0.0:1788875289.374838:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218066304 00000100:00100000:0.0:1788875289.374851:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065920 00000100:00100000:0.0:1788875289.374853:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065920 00000100:00100000:0.0:1788875289.374867:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218066176 00000100:00100000:0.0:1788875289.374869:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218066176 00000100:00100000:0.0:1788875289.374953:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:0.0:1788875289.374962:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2350:x1875771218065792:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.374992:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2350:x1875771218065792:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.374999:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 16 00000100:00100000:0.0:1788875289.375012:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1788875289.375018:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2350:x1875771218066304:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.375051:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2350:x1875771218066304:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.375058:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 17 00000100:00100000:0.0:1788875289.375069:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875289.375075:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218065920:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.375098:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c03ea99-fe93-4040-b0ab-19354d12a812+5:2349:x1875771218065920:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 23us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.375103:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 18 00000100:00100000:0.0:1788875289.375114:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00100000:0.0:1788875289.375120:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218066176:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:0.0:1788875289.375141:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a3628b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d842d8e5-7831-40d7-899a-0f57c20fe6b7+5:2349:x1875771218066176:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 22us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788875289.375155:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 19 00000100:00080000:0.0:1788875289.375184:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788875289.375189:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788875289.375192:0:14484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788875289.376222:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771218065536 00000100:00100000:3.0:1788875289.376248:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771218065536 00000100:00100000:3.0:1788875289.376316:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.7@tcp, seq: 125 00000100:00100000:3.0:1788875289.376326:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5a36264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2350:x1875771218065536:12345-192.168.202.7@tcp:400:kworker.0 00000100:00100000:3.0:1788875289.376404:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5a36264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:287afd9b-867a-48fc-8e7f-a9e11341315a+13:2350:x1875771218065536:12345-192.168.202.7@tcp:400:kworker.0 Request processed in 80us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788875289.376413:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.7@tcp, seq: 125 00000001:02000400:3.0:1788875289.494983:0:16756:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788875290.254405:0:14477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29681 lines, 29681 kept, 0 dropped, 0 bad.